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Within  the  scope  of  NATO  missions,  the  characterisation  of  targets  is  of  primary  lnteres.  because  it  is  needed  for  establishing 
the  tactical  situation,  optimising  target  acquisition  systems  and  optimising  armaments  utilisation.  The  problem  of  detection, 
recognition  and  identification  is  becoming  more  and  more  difficult  because  of  increased  enemy  defence  ranges,  improved 
camouflage  and  jamming  techniques  and  reduction  in  target  signatures.  Consequently  the  operational  specificauons  of 
airborne  systems  emphasise  the  necessity  to  obtain  information  on  threats  which  have  low  signatures  and  are  equipped  with 
counter-measure  systems.  The  use  of  these  technologies  dictates  multispectral  analvsis  of  targets.  Solutions  could  be  derived  by 
the  fusion  of  data  from  several  sensors 

These  solutions  must  take  into  account  the  need  to  reduce  crew  workload  which  could  be  achieved  by  automation 

This  symposium  will  begin  with  a  session  pointing  out  the  needs  expressed  by  the  users  of  airborne  target  acquisition  and  fire 
control  systems  (including  aircraft,  helicopters,  unmanned  air  vehicles  (UAV),  missiles,  etc.)  The  performance  and  limitations 
of  present  techniques  will  then  be  reviewed  and  analysed  The  "multi-sensor  techniques"  capabilities  will  then  be  described  for 
future  Air-to-Air  Combat  and  Air-to-Surface  attack  missions. 


The  sessions  are. 


Session  I  Expression  of  Needs 

Session  II  Integrated  Systems  Architectures  and  Technologies 
Sesion  111  Integrated  Systems  Algorithms 
Session  IV  Short-Term  Systems  and  Equipments 
Session  V  Longer  Term  Systems 


Theme 


Aooesnlon  For 

”btis  gram 

DTIC  TAB 
Unannounced 
Justlf leation_ 


□ 

a 


istributlon/ 


Dlst 


Availability  Codes 
Avail  and/or 
Special 


i 


.1 


Dans  le  cadre  des  missions  Uc  1'OTAN,  la  caractensation  des  objectifs  est  primordiale  car  elle  permet  detablir  la  situation 
tactique,  d’optinuser  les  systemes  d’acquisition  d'objectifs  et  les  doctrines  d'utilisation  des  armements. 


Les  problemes  lies  a  la  detection,  a  la  reconnaissance  et  a  1'identification  deviennent  de  plus  en  plus  complexes  a  cause  de 
l’accroissement  des  polices  des  systemes  de  defense  ennemis,  des  ameliorations  constantes  dans  les  doma'nes  du  camouflage, 
des  progres  revolutionnaires  en  matiere  de  furtivite.  En  consequence,  les  specifications  operationnelies  des  systemes 
aeroportes  mti'ent  de  plus  en  plus  I’accent  sur  la  necessite  d'obtcntion  du  renseignement  sur  les  menaces  discretes  et  equipees 
de  systemes  de  contremesures.  La  detection  et  ['identification  de  telles  menaces  exigent  des  analyses  multisoectrales.  Ces 
solutions  conduisent  a  la  fusion  d’informations  de  plusieurs  senseurs. 


De  telles  solutions  doivent  egalement  prendre  en  compte  la  reuuction  de  la  charge  de  travail  de  lequipage 

Ce  symposium  debutera  par  une  session  desttnee  a  faire  le  point  sur  les  besoins  expnmes  par  les  utilisateurs  de  systemes 
d'acquisition  d’objectifs  et  de  conduite  de  tirs  aeroportes  (sur  avions,  helicoptercs,  UAV,  missiles) 

Le  point  des  techniques  actuelles  avec  leur  limitations  sera  analyse  et  les  possibilities  offertes  pai  les  “techniques  multicapteurs# 
seront  decrites  pour  le  combat « Air-Air»  et  pour  l’attaque  «  Air-Surface ». 


Les  sessions  seront  les  suivantes 


Session  1 
Session  II 
Session  III 
Session  IV 
Session  V 


Expression  des  Besoins 

Architectures  et  Technologies  des  Systemes  Integres 
Algorithms  des  Systemes  Integres 
Applications  a  Court  Terme 
Applications  a  plus  Long  Terme 
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1.  INTRODUCTION  erficacement  en  concert  les  unes  avec  les 

autres.  Cette  capacite  fQt  la  clfe  de 

Mr  Chairman,  good  morning  ladies  and  1 ' impressionnante  flexibilitA  dAmontrAe 

gentlemen.:  Bongour  mesdames  et  par  les  forces  en  presence  et  du  succAs 

messieurs.  En  tanu  que  Chef  de  la  indAniable  de  1’OpAration  Tempete  du 

Doctrine  et  des  Ope. a  ions  Aeriennes,  dfcsert,- 

c'est  avec  grand  plaisi"  que  j'ai  accepts 

de  me  goindre  a  vous  augoud'hui  et  The  increasing  importance  of  the 

d' avoir  l'honneur  de  lance •  cette  peacemaking  role  on  the  international 

importantc  conference.  Le  s  qet  traite,  scene  will  mean  that  Canada,  as  an  active 

soit  les  technologies  enton-  *■  les  member  of  NATO  and  the  United  Nations, 

systAmes  de  detection  int6g.ee  t  de  will  be  called  upon  more  often, 

guidage  terminal,  constitue  un  do-aine  do 

grande  portAe  qui  me  tient  beaucoup  d  Peacemaking  implies  that  one  is  willing 

corur.  to  fight  to  restore  peace.  This  requires 

a  well  equipped  and  coordinated 

2.  BACKGROUND  multinational  force  to  engage  in  this 

kind  of  operation.  To  achieve  success,, 

Beforn  audre-jsing  the  subject  at  hand  I  ai  demonstrated  in  the  Persian  Gulf, 

feel  it  is  necessary  to  place  future  strategic  and  tactical  sensor  fusion  must 

weapons  platform  requirements  in  the  be  achieved  between  participating  forces 

context  of  today's  world.  In  doing  so  we  to  effectively  build  an  accurate  order  of 

must  recognize  the  risk  involved  in  bai tie  and  to  conduct  effective  battle 

predicting  the  future  and  also  acknowledge  management..  An  integral  part  of  the 

the  significant  political  and  military  argum'm  for  multisensor  fusion  is  that 

alliance  changes  that  have  come  about  in  most  nations  can  no  longer  afford  gilt 

recent  years  and  are  bound  to  continue  for  edged  solutions  to  specific  problems.  In 

some  time.  the  face  of  budget  constraints  most 

procurement!-  must  be  low  cost  and  capable 
The  requirement  for  sensor  fusion  for  fire  of  multiple  tasks, 
control  systems  discussed  to  date  has  been 

on  a  scenario  that  is  to  some  extent  3.  DISCUSSION 

outdated.  However  the  requirement  for 

sensor  fusion  still  exists  within  the  NATO  The  bringing  togt  her  and  integration  of 
context  and  is  in  the  interests  of  peace  the  many  sensors  t  at  would  be  present  in 

making  worldwide.  Now,  let  me  amplify  a  multinational  fo* is  no  easy  task.- 

this  further.  However,  the  resultig  fusion  into  a 

coherent  package  ...  *  “ential  to  minimize 

For  more  than  forty  years,  the  clash  of  effort  and  expense  whi-  maximizing  the 

east-west  ideology  has  dominated  the  world  fighting  capability  of  .he  force.  At  the 
scene.  This  relationship  no  longer  strategic  levo’ ,  this  men’s  that  we  in 

carries  the  threat  of  imminent  large  scale  NATO  must  continue  to  do  i.e  research  and 

conflict  between  NATO  and  the  now  development  necessary  to  fi-d  more 

nonexistent  Warsaw  Pact.-  However,  smaller  effective  ways  to  fuse  o  ir  national 
scale  conflicts  are  likely  to  continue  in  detection  and  acquisition  sysiems  with 

other  areas  of  the  world,  as  witnessed  by  all-source  mtelligenc  in  orde'  to  best 

the  Persian  Gulf  war,  the  war  in  meet  potential  challenges  and  coopitmente 

Afghanistan,  Cambodia  and  now  Yugoslavia.-  in  the  future. 

Dans  le  cas  ou  les  membres  des  Within  NATO  we  have  progref sod  with  BICES 

Nations-Umes  seraient  appelees  a  retablir  (the  Battlefield  Information  Collection 

la  paix  dans  ces  regions,  ge  crois  and  Exploitation  System)  for  fusion  of 

fermement  en  l1  importance  d' avoir  une  battlefield  information.;  A  natural 

force  de  l'OTAN  standardisee  oil  les  forces  extension  is  the  fusion  of  tactical 
militaires  nationales  peuvent  fonctionner  sensors  to  better  manage  our  war  fighting 
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assets  by  improved  target  acquisition, 
weapons  selection,  prioritization  and 
finally  fire  control  systems., 

I  am  pleased  to  see  that  sensor  fusion 
will  be  thoroughly  discussed  during  this 
Symposium  as  I  believe  it  represents  a 
potential  breakthrough  and  will  influence 
the  way  we  conduct  operations  in  the 
future.  Frr  example,  long  range 
identification  temains  an  unresolved 
problem,  se. por  improvement  and  fusion  are 
essential  to  a  resolution  of  this 
challenge.-  The  fusion  of  various  radar, 
electro-optic#,  infra-red  and  other  sensors 
will  also  help  to  eliminate  periods,,  such 
as  in  bad  weather  r, •  darkness,  when  at 
present  normal  operations  are  reduced  or 
t  worst,  must  cease.:  Conversely,  we  can 
see  that  sensor  fusion  will  also  reduce 
the  potential  vulnerabilities  of  single 
sensor  dependency. 

To  Canada,  on  the  air  side,  this  means 
integrating  the  weapon  system  capabilities 
of  the  CF-18  squadrons  we  ha  *e  committed 
as  rapid  deployment  contingency  forces 
with  other  national  and  NATO  assets  like; 
reconnaissance  oatellites,  AWACS,  JSTARS, 
UAVs,  and  other  radar,  optic  or  IR  sensors 
to  name  a  few.  In  order  to  use  our  weapon 
systems  to  maximum  advantage,  we  must  fuse 
our  capability  in  such  a  manner  as  to 
reduce  the  risk  of  overkill  but  ensure 
that  when  a  weapons  system  is  assigned  a 
target  it  is  positioning  and  capable  of 
dealing  effectively  with  that  target. 

Our  experience  in  the  Persian  Gulf  war 
showed  that  Can? dians  were  adequately 
prepared  for  the  air-to-air  war  but  lacked 
the  precision  guided  munitions  necessary 
to  take  advantage  of  the  CF-181 s  fire 
control  capability  to  deliver  some  types 
of  smart  munitions.  Yet  we  also  noted 
that  while  we  lacked  the  target 
designators  and  control  systems  necessary 
to  deliver  other  types  of  sophisticated 
weapons,  we  were  able  to  fuse  our 
resources  with  other  nations  f o  get  our 
weapons  on  target. 

An  example  of  the  way  of  the  future  was 
the  use  of  maturing  American  unmanned  air 
vehicle  (UAV)  systems  in  the  Persian 
Gulf.  They  demonstrated  the  ability  to 
locate  and  identify  targets  without 
putting  human  resources  at  risk.  They 
were  also  used  to  deceive  enemy  air 
defence  systems  and  when  equipped  with 
cameras  were  widely  used  to  adjust  naval 
gunfire,  artillery,  check  weather 
conditions  at  the  target  and  assess  battle 
damage . 

Another  system  that  proved  valuable, 
p  '-ticularly  to  the  CF-18,  was  the  ability 
to  data  link  information  from  the  USN 
tactical  operations  centre  direct  to  the 
CF  fighter  cockpit.;  In  the  crowded 
communicat ior.  environment  such  as  that 
present  in  the  Persian  Gulf,  the  timely 
delivery  of  fused  tactical  data  link 
information  enable  us  to  avoid  the  long,, 
sometimes  confusing,  transmissions  that 
would  have  added  a  degree  of  vulnerability 
to  the  mission  at  hand. 


4.  CLOSING  REMARKS 

Je  pourrais  m'attarder  plus  longueraent 
sur  le  sujet  de  fusion  des  capteurs  mais 
jugeant  par  la  liste  des  eminents  invites 
en  presence,  je  vais  leur  confier  la 
tache  d’elaborer  davantage  sur  ce  sujet.. 

However,  as  a  closing  note  to  be 
considered  in  your  discussions,  I  remind 
you  that  most  of  our  nations  are  and  most 
likely  will  continue  to  be  constrained  by 
shrinking  defence  budgets  and  increasing 
weapon  systems  costs.  Therefore, 
cost-effective  solutions  must  play  an 
important  part  in  your  deliberations. 

These  facts  make  your  task  at  this 
Symposium  assume  an  importance  that  is 
critical  to  the  success  cf  future  NATO 
and  other  alliance  military  operations .- 
I  can  assure  you  that  we  in  the  CF  will 
be  paying  close  attention  to  this  issue 
in  light  of  our  recent  defence  review  and 
will  be  extremely  interested  in  the 
results  of  this  effort.  I  hope  you  have 
a  productive  meeting.'  That  completes  my 
presentation.  Once  again,  I  wish  you 
every  success  in  your  deliberations.’ 
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Mesdames  et  Messieurs, 

C'est  un  honr  eur  pour  moi  d'etre  Chairman  de  ce  62eme  Symposium  du  Panel  Avionic  de  I'AGARD.  Lorsque  le  theme  de  ce 
Symposium  fut  choisi,  voici  plus  de  deux  ans,  je  ne  pensais  pas  qu'il  deviendrait  si  rapidement  d'une  telle  actualite  lors  des 
e.enements  qui  se  sent  deroules  en  debut  d'annee  dans  le  Golfe.  Chacun  a  pleinement  ressenti  l'importancc  qu'il  y  avail  a 
...spoa-r  dc  tei  fouques: nines  ct  fortement  automat  ism  pour  (Acquisition  des  Objectifs  ct  les  Conduites  de  Tir  Acroportees  Le 
theme  dehattu  pendant  ces  quelques  joumecs  prend  done  un  relief  particular,  et  ce  d’autant  plus  que  dans  l’avemr  les 
specifications  se  feront  de  plus  cn  plus  exigeantes  en  matiere 

—  de  discretion  ct  de  fumvite, 

—  d’accroissement  des  distances  de  securite,  et,  par  consequent,  des  portecs  d'acquisition, 

—  de  resistance  aux  contre-mesures, 

—  dc  leduction  dc  la  charge  de  travail  des  equipages. 

—  de  polyvalence  des  systemes. 

D’oii  la  neccssite  de  faire  appcl  a  de  multiples  capteurs  et  de  trailer  leurs  informations  pour  faire  echec  aux  moyens  de 
<  anumflage,  de  leurrage  et  de  brouillage  de  I'ennemi  La  multiplicity  des  capteurs  et  des  fonctums  exige  une  integration  de  plus 
en  plus  poussee  et  des  moyens  de  traitemcnt  cn  temps  reel  de  plus  en  plus  performants,  compatibles  d'encombrements,  masses, 
consummations  et  coiits  raisonnables  Ces  aspects  seront  discutes  au  cours  de  ce  Symposium,  et  ce,  dans  divers  cadres 
d'utilisation, 

—  Avions  de  combat  et  u’attaque  au  sol. 

—  Helicoptercs, 

—  U  A  V, 

—  Missiles 

Je  tiens  a  -emercier  les  conferene.ers  qui,  pour  la  plupart,  ont  repondu  tres  lapidement  au  "Call  for  Papers". 

Ious  mes  remerciements  egalement  au  Comite  Technique  de  Programme. 
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Je  remerue  ce  comite  pour  ses  actions  efficaces  dans  la  recherche,  la  selection  des  exposes,  et  dans  I’orgamsation  des  sessions 
du  Symposium  Je  remercie  egalement  le  Lt  Col  Fred  Sautter  qui  a  reniplace  recemment  le  Lt  Col  Clay  commt  Executive 
Officer  Aujourd  hui.  lundi  7  octobre  la  Session  I  traitera  de  (’Expression  des  Besoms,  grace  a  quatre  "Invited  Papers”  qui 
seront  presentes  ce  matin  La  Session  tl,  relative  aux  Architectures  et  aux  Technologies  des  Systemes  Integres,  debutera  cet 
apres-midi  et  s'achevera  demain  8  octobre  en  milieu  de  matinee  Ce  meme  jour,  la  Session  III  sera  centree  sui  les  problemes 
d'Algonthmie  En  fin  d'apres-uudi  et  mercred  V  matin  en  Session  IV,  seront  presentes  des  exemples  de  Systemes  et 
d  Equipement  en  cours  d’Essais  ou  de  Deseloppement  L'apres-midi  sera  consacree  a  des  visites  techniques.  Jeudi  It)  octobre 
malm,  la  Session  V  sera  consacree  a  la  description  de  quelques  Projets  de  Sysiemes  futurs  Nous  prevoyons  une  Table  Ronde, 
egalement  jeudi  matin  en  Session  VI  afin  de  donner  libre  cours  a  une  discussion  generate  Compte  tenu  de  I'aimulation  de 
certains  exposes,  le  Symposium  s'achevera  jeudi  10  en  fin  de  matinee 
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In  order  for  sound  and  timely 
decisions  to  be  made,  commanders  and 
staffs  require  a  continuous  source  of 
information  about  the  tactical 
situation  they  are  facing.  Enemy 
dispositions  and  and  intentions  are  of 
particular  importance  to  any  commander, 
and  present  the  greatest  challenge  to 
discern..  Unmanned  Air  Vehicle  (UAV) 
technology  offers  a  potential  solution 
to  augment  a  commander's  surveillance 
resources.  UAVs  offer  the  land  force 
commander  the  possibility  of  conducting 
wide  area  surveillance  and  target 
acquisition  in  near  real  time.  UAVs 
will  extend  tha  range  of  observed  fire 
to  the  limits  of  available  weapons.; 
Other  supporting  functions  such  as 
communications  relay,  electronic 
warfare  and  chemical  recconnaissance 
wil  also  benefit  from  a  UAV  platform. 
Maritime  forces  could  employ  UAVs  from, 
or  in  support  of  small  ships  to  augment 
manned  aircraft.  Over-the-Horizon 
Targeting,  Battle  Damage  Assessment, 
Electronic  Warfare  and  Anti-Submarine 
Warfare  are  some  of  tha  functions  which 
could  be  supported  by  a  maritime  UAV. 
This  paper  will  examine  the 
requirements  for  UAVs  to  support  both 
land  and  maritime  operations.  The 
characteristics  and  concept  of 
employment  which  make  UAVs  desirable 
for  military  applications  will  be 
discussed. 


1.  Surveillance  and  then  targeting 
form  the  basic  elements  of  every 
weapr  's  system.  In  early  conflicts, 
the  at. ’ tty  to  see  an  enemy  was 
essential  before  you  could  employ  your 
own  weapons.  This  was  not  a  problem  as 
the  range  of  the  weapons  was  very 
short.  As  a  result,  line  of  sight 
restricted  early  conflicts  on  both  the 
sea  and  land. 

2.  As  weapons  technology  improved,  so 
did  the  effective  range  of  the  weapons.. 
This  extended  the  range  requirement  for 
surveillance  and  targeting.  Natrons 
used  kites,  balloons  and  later  aircraft 
ir.  an  attempt  to  extend  the  line  of 
sight.  Technological  advances  such  as 
radar  and  IR  sensors  augmented  visual 


surveillance,  but  the  sight  line  limit 
was  still  present.  With  the 
exploitation  of  height  to  extend  sight 
lines  came  systems  designed  to  deny  the 
enemy  the  use  of  height.  Sophisticated 
air  defence  systems  evolved  which  made 
the  use  of  manned  platforms  risky  and 
in  soma  situations  politically 
unacceptable, 

3 .  Technology  has  extended  our  use  of 
height  to  space.  Space  based 
surveillance  platforms  ara  the 
"Cadillac"  solution  to  the  surveillance 
and  targeting  problem.;  The  cost, 
frequency  of  coverage  and  conflicting 
user  demands  make  this  solution 
impractical  for  many  tactical 
applications.  Small  Unmanned  Air 
Vehicles  do  however  offer  a  significant 
potential  for  fulfilling  the 
surveillance  and  targeting  role. 

4. ;  This  paper  will  examine  the 

various  operational  requirements  for 
unmanned  air  vehicles  concentrating  on 
the  naval  and  land  roles  of  these 
systems. 


OPERATIONAL  CONCEPT 

5.  A  Naval  Unmanned  Air  Vehicle 
system  must  operate  within  a  country's 
existing  force  structure  and  within  the 
guidelines  set  out  in  the  country's 
maritime  strategy.-  A  maritime  strategy 
may  have  several  aims: 

a.  to  be  aware  of  all  activities 
in  maritime  areas  for 
sovereignty,  economic 
management  of  resources,  and 
the  environment; 

b.  to  provide  a  secure 
environment  within  which 
legal  and  regulatory 
enforcement  can  proceed 
unhindered  and  unchallenged; 

c.  to  act  against  undesirable 
activities  in  maritime  areas; 
and 


d.  to  make  a  contribution  to 
international  cooperative 
security  endeavours.  This 
includes  collective  defence, 
arms  control  and 
peacekeeping. 

6..  The  ability  to  conduct 
surveillance  and  targeting  over  marine 
areas  of  interest  is  a  cornerstone  of 
any  maritime  strategy.;  The 
surveillance  requirement  exists  in  both 
peacetime  and  wartime  operations. 

Naval  units  must  be  capable  of 
conducting  surveillance  and  targeting 
while  providing  for  their  own  self- 
defence  in  a  hostile  environment.; 

7.  The  war  at  sea  is  a  three 
dimensional  affair  consisting  of  the 
sea  surface,  the  air  space  above  it  and 
the  waters  below.  For  ships  to  operate 
effectively  in  these  warfare  areas  they 
require  a  capability  in  Electronic 
Support  Measures  (ESM) ,  Electronic 
Counter  Measures  (ECM) ,  communications 
relay,  Over-The-Horizon  Detection, 
localization,  classification  and 
targeting,  Battle  Damage  Assessment  and 
Anti-submarine  Warfare  (ASW) . 

Extending  the  horizon  of  the  ships 
sensors  can  improve  all  of  these 
capabilities  by  increasing  the  time 
available  to  respond  to  the  threat.. 

8.  Manned  aircraft  have  traditionally 
carried  out  surveillance  and  targeting 
missions  beyond  a  ships  sensor  horizon. 
These  aircraft  may  be  either  ship  or 
shore  based  units.-  Increases  in  the 
capability  of  shipboard  defensive 
systems  has  made  manned  aircraft 
missions  increasingly  hazardous.  The 
manned  aircraft  normally  used  to  extend 
the  sensor  horizon  must  operate  in  a 
high  risk  environment  during 
hostilities. 

9.  Unmanned  Air  Vehicles  offer 
potential  for  significantly  enhancing  a 
ship's  sensor  and  weapon  system 
capability  while  reducing  the 
dependence  on  costly  manned  aircraft. 
Maritime  UAVs  have  long  been  of 
interest  but  it  is  only  recently  that 
key  UAV  technologies  have  advanced  to 
the  point  where  unmanned  systems  are 
realistic  for  small  ships.; 

10..  For  small  ships,  UAVs  are  seen  as 
a  cost-effective  means  of  offsetting 
the  lack  of  or  complementing  a  limited 
number  of  on-board  aircraft.  UAVs  may 
reduce  the  loss  rate  of  manned  aircraft 
in  high  risk  environments  and  improve 
the  self-defence  capability  and  mission 
effectiveness  of  surface  combatants. 

The  conclusion  reached  by  national  and 
NATO  studies  is  that  it  is  possible  to 
operate  UAVs  from  frigate-size  and 
smaller  ships  and  that  operational 
roles  exist  for  such  systems. 
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11.  UAV (ESM)  systems  would  extend  the 
ship's  ESM  sensor  ranges.  This  allows 
monitoring  of  hostile  force  activity 
without  drawing  on  shipboard 
helicopters  or  maritime  patrol 
aircraft.  The  ability  to  cross  fix 
between  two  UAV's  or  a  UAV  and  ship 
provides  a  better  surface  picture  to 
the  Task  Force.  It  is  desirable  to 
deploy  a  system  which  would  cover  both 
the  communications  and  radar  frequency 
bands.  Bearing  accuracy  of  5  degrees 
or  less  is  desirable  as  is  an  onboard 
threat  library. 

EXsctr^niq  Countermeasures  (ECM) 

12.  ECM  in  the  naval  environment 
exists  in  two  forms,  defensive  and 
offensive.  The  threat  of  the  high 
speed,  low  altitude  anti-ship  missile 
has  become  more  prevalent.;  The  time 
available  to  defeat  these  weapons  has 
decreased.  The  UAV(ECM)  is  seen  as  a 
useful  adjunct  to  existing  systems  by 
extending  a  jammer's  horizons.  This 
increases  the  time  available  to  respond 
to  the  threat. 

13.  A  ship  could  deploy  a  UAV (ECM)  in 
a  station  relative  to  the  ship  for 
extended  periods.  With  the  UAV(ECM) 
prepositioned  on  the  threat  axis,  the 
ship  can  respond  rapidly  as  soon  as  the 
threat  radiates.  The  UAV(ECM)  would 
attempt  to  confuse  the  missile  through 
false  target  generation,  or  confuse  it 
through  various  jamming  techniques. 
Chaff  dispensing  from  the  UAV(ECM)  is 
an  alternative  to  seduce  and  confuse 
targeting  radars.  Through  the  UAV(ECM) 
data  link  sub-system,  cooperative 
jamming  could  be  achieved  between 
ship's  jammers,  the  UAV(ECM)  system  and 
target  ship's  chaff  and  decoy  systems.; 


14. -  In  an  offensive  role.  The  UAV(ECM) 
system  would  have  a  geometry  advantage.; 
The  UAV(ECK)  can  conduct  jamming 
without  providing  hostile  forces  with  a 
"Jamming  strobe"  bearing  line  back  to 
own  forces.  The  UAV (ECM)  system  can 
also  operate  closer  to  enemy  forces 
without  risking  loss  of  life.-  This 
provides  a  higher  Jammer  to  Signal 
Ratio  which  increases  the  effectiveness 
of  the  jamming., 

15.  A  typical  ECM  payload  could 
consist  of  a  noise/repeater  jammer 
system  and  CHAFF.  Broadband  coverage 
for  the  noise/ repeater  jammer  is 
aesirable. 

Communications  Relay  fCR) 

16.  Good  communications  are  essential 
to  a  Task  Group.  Because  of  the 
increased  ranges  of  senors  and  weapon 
systems,  the  ships  of  a  Task  Group  may 
operate  in  dispersed  formations  over 
distances  approaching  and  often 
exceeding  100  NM.  Therefore  over-the- 
horizon  communications  and  good  data 
links  are  mandatory.  The  current 
methods  used  include  HF  radios  and  UHF 
radios  using  airborne  relays  such  as 
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helicopters,  maritime  patrol  aircraft 
and  satellites.  HF  radio  is  the  least 
desirable  because  of  the  potential 
intercept  ranges.  UHF  radios  require 
some  form  of  airborne  relay  to  provide 
over  the  horizon  communications.  Thi3 
is  rarely  possible  24  hours  a  day  nor 
is  it  cost-effective. 

17.  An  automatic  data  link  or  voice 
UHF  relay  provided  by  an  UAV(CR)  would 
insure  timely  and  accurate  transfer  of 
information  between  the  C3  ship  and 
other  dispersed  units.  For  example, 
two  towed  array  ships  separated  by  more 
than  60  NM  from  each  other  may  be 
processing  a  cross  fix  on  a  submerged 
contact.  They  could  use  the  UAV(CR)  to 
provide  data  link  to  each  other  and  to 
the  Task  Group  Command  ship  which  may 
be  100  NM  away.-  The  payload  should 
ideally  be  multichannel  and  must 
accommodate  modern  frequency  hopping 
radios. 

Over-the-Horlzon.  Detection. 
Localization. 

ClMBlfigatlon.  larfl9tlna_aJDiL-Baitl< 
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(OTHT/BDA) 

18.  Many  surface  combatants  carry 
surface-to-surface  missiles  such  as 
Harpoon  and  Tomahawk.  These  missiles 
require  accurate  targeting  information 
to  be  effective.  At  present, 
helicopters  or  maritime  patrol  aircraft 
provide  the  necessary  third  party 
targeting.  In  doing  so  however,  they 
expose  themselves  to  extreme  risk  from 
a  targets  air  defence  systems. 

19.  The  ship  would  employ  the 
UAV(OTHT/BDA)  in  peacetime  or  rising 
tension  to  classify  surface  contacts. 
The  aim  is  to  maintain  as  accurate  a 
surface  plot  as  possible.  Once 
hostilities  begin,  the  UAV  (OTHT/BDA) 
targets  these  contacts  for  engagement 
at  the  maximum  range  of  the  shipboard 
weapon  systems.  The  range  required  for 
a  UAV  to  be  effective  in  surveillance 
and  targeting  would  have  to  be  further 
than  the  range  of  present  weapon 
systems.  This  is  to  enable  enough  time 
to  identify  the  target  and  gain 
targeting  data  before  the  target  enters 
the  maximum  engagement  range. 

20..  After  an  engagement,  *  UAV  would 
close  a  contact  and  determine  the  level 
of  damage.  The  UAV  which  conducts  the 
targeting  may  be  the  UAV  tasked  with 
BDA.  The  UAV  tasked  with  BOA  must 
provide  high  resolution  imaging  data  to 
allow  for  assessment  of  structural  and 
system  damage.  Multi-spectral  sensors 
would  enhance  BDA.  The  UAV  providing 
BDA  must  also  provide  enough  targeting 
information  to  enable  ships  to  conduct 
a  second  engagement  if  required.  The 
payload  most  suited  for  surveillance, 
targeting  and  battle  damagi  assessment 
is  a  combination  of  ESN,  Imaging  Radar, 
Forward  Looking  Infra-red  (FLIR)  or  Low 
Light  Level  TV., 
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21.  With  the  longer  detection  ranges 
generated  by  towed  array  sonar  systems, 
there  is  a  requirement  to  provide 
reactive  vehicles  to  localize  and 
prosecute.  The  Navy  currently  uses 
helicopters  and  MPAs  to  carry  out  these 
tasks.  A  limited  numbers  of  these 
resources  are  available  to  the  Task 
Group.  Ships  could  employ  the  UAV(ASW) 
to  assist  by  dropping  small  sonobuoys 
in  various  scenarios.  Ships  could 
employ  UAV's  to  monitor  and  relay 
acoustic  information  from  previously 
deployed  sensors  to  the  Task  Group. 
Although  the  UAV  could  not  take  the 
place  of  current  air  assets,  it  would 
relieve  them  of  high  risk  or  tedious 
tasks. 

MiasiPH.  timiiM 

22.  Ideally,  ships  will  deploy  the  UAV 
in  a  similar  manner  as  manned 
helicopters.  The  unit  commander  can 
launch  the  UAV  at  his  discretion  to 
fulfil  the  combat  mission  of  the  ship. 
The  Task  Group  Commander  may  also 
deploy  the  UAV  as  a  force  asset  in 
response  to  requests  from  other  units.- 


23.  The  mission  planning  process 
provides  detailed  flight  plans 
necessary  to  conduct  a  UAV  mission.:  In 
its  simplest  form  this  function 
combines  and  prioritizes  UAV  task 
orders  requested  by  a  variety  of 
sources  within  the  ship  and  Task  Group. 
Ship's  staff  develop  the  plans  based  on 
the  current/ expected  UAV  situation 
status,  as  wall  as  standard  operating 
procedures.  The  UAV  Operator  enters 
approved  plans  into  the  Command  and 
Control  System  for  use  by  the  proper 
combat  system  operators..  The  Operator 
uses  the  mission  planning  process  to 
modify  missions  in  response  to  changes 
in  the  tactical  situation  and  changes 
in  the  UAV  status. 

24.  The  UAV  Operator  would  carry  out 
the  mission  plan  by  creating  a  flight 
plan  for  the  UAV  and  inserting 
waypoints  into  tho  system.  Once 
airborne  the  Operator  controls  the 
flight  path  of  the  UAV  by  the 
adjustment  of  waypoints.  The  UAV  would 
be  capable  of  operating  on  the 
preprogrammed  flight  plan  if  loss  of 
the  data  link  with  the  ship  occurs. 
Transmission  of  the  payload  data  would 
be  in  near  real  time.  A  provision 
could  exist  to  store  data  onboard  the 
UAV  for  later  retransmission. 

Single  Operator  Workstation.  Concept. 

25.  To  fit  the  UAV  system  within  the 
space  constraints  of  a  ship,  the 
shipboard  control  station  should  be  a 
single  operator  workstation.  This 
workstation  would  conduct  both  mission 
planning  and  flight  control  of  the  UAV. 
The  variety  of  tasks  that  the 
workstation  must  perform  demands  a 
highly  versatile  multifunction  display 
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the  ship's  combat  system.  Sensor  data 
would  be  distributed  throughout  the  combat 
data  system  to  the  operators  trained  to 
interpret  the  data.  Control  of  the  air 
vehicle  and  payload  may  be  in  response  to 
predefined  instructions  in  the  flight 
plan,  by  the  UAV  Operator  or  in  response 
to  the  needs  of  ship's  combat  system 
operators  using  the  UAV  data.  The 
recovery  phase  includes  the  control  and 
mcnitoring  of  air  vehicle  to  the  recovery 
point  and  supervision  of  the  recovery 
procedure. 

29.  Ships  would  deploy  UAVs  wherever  the 
fleet  conducts  operations.  The  UAV  would 
operate  in  all  weather  conditions 
including  extreme  cold  and  heat.  Ship 
deck  motion  limits  would  be  similar  to 
those  of  the  shipboard  helicopter.. 

30.  The  integration  of  UAVs  with  other 
aircraft  would  require  the  adoption  of 
special  airspace  requirements  for  the 
conduct  of  safe  UAV  flight.  It  is  likely 
that  manned  aircraft  and  UAVs  would  fly 
simultaneously.  The  maintenance  of  safe 
separation  distances  between  all  types  of 
air  vehicles  is  essential.  In  so  far  as  is 
practical,  the  use  and  control  of  UAVs 
would  be  the  same  as  for  manned  aircraft.. 
The  control  of  emissions  from  the  UAV 
would  follow  as  closely  as  possible  the 
established  procedures  and  governing 
directives  for  other  aircraft  operating  in 
the  same  task  group. 

31.  Ship's  may  operate  multiple  UAVs  to 
provide  on  station  relief  or  greater 
coverage  in  the  area  of  interest.  The 
extent  of  multiple  operations  would  depend 
on  the  intensity  of  activity,  number  of 
aircraft  operating  in  the  area  of 
interest,  data  link  capabilities  and  the 
extent  that  an  operator  can  manage 
multiple  UAVs  from  a  single  console.; 

SUPPORT  ABILITY 

32.  Where  possible,  ship's  will  store 
UAVS  in  the  ship's  helicopter  hanger.;  For 
ships  without  hangars,  storage  of  the  UAV 
would  require  a  special  container  to  allow 
modular  installation  of  the  systems.  UAVs 
stored  in  helicopter  hangars  must  not 
interfere  with  the  storage  of  the 
helicopter  in  the  same  hangar. 

33.  On  all  ship  classes,  operation  and 
maintenance  of  UAVs  should  use  existing 
ship's  crew  where  possible.  There  is  no 
intention  to  cross-train  Helairdet 
technicians  to  maintain  or  operate  the 
UAV.  UAV  operations  must  be  independent 
of  but  complementary  to  helicopter 
operations  to  insure  availability  of  the 
system  when  the  Helairdet  is  not  embarked 
or  unavailable.  There  may  be  a 
requirement  to  increase  the  ship's 
firefighter  complement  in  response  to  the 
increased  flight  deck  activity.  UAV 
operators  would  be  trained  members  of  the 
ships  crew.  UAV  Operators  would  not 
require  special  prerequisite 
qualifications  however,  experience  in  air 
control  such  as  an  ASAC  qualification 
could  become  a  requirement.- 


34.  Units  would  to  deploy  UAVs  for  up  to 
six  months  at  a  time.  Shipboard  personnel 
would  only  be  responsible  for  first  line 
maintenance. 

35.  Operation  of  the  UAV  would  be  at  a 
rate  similar  to  the  shipboard  helicopter.. 
Therefore  there  is  a  requirement  to 
operate  the  UAV  system  approximately  100 
hours  per  month  for  peacetime  operations 
at  one  sortie  per  day  and  a  peak  wartime 
requirement  up  to  18  hours  per  day  for 
three  days. 


II.  LAND  BASED  UAV  OPERATIONS 
OPERATIONAL  CONCEPT 

36.  The  concept  of  operations  for  UAVs 
employed  by  land  forces  is  very  different 
from  that  developed  for  naval  UAVs.  The 
most  important  reason  for  this  is  that  the 
physical  environment  differs  immensely 
from  that  of  naval  forces  because  the  land 
environment  offers  a  variety  of  terrain. 
This  causes  tactics  to  be  different  in 
concept  and  execution;  creating  different 
operational  requirements.-  Land  forces  may 
find  themselves  in  operational  situations 
that  require  radically  different 
approaches.  The  requirements  of  an 
internal  security  operation  can  be  very 
different  than  those  of  general  war. 

37.  Since  information  is  hard  to  obtain, 
commanders  must  strive  to  improve  their 
knowledge,  to  reduce  their  uncertainty 
about  what  is  really  happening  on  the 
battlefield.  It  has  been  argued  that  in 
modern  warfare  commanders  are  frequently 
less  certain  about  their  enemy  and  what  is 
going  on  than  their  predecessors  were  a 
thousand  years  ago, 

38.  All  commanders  will  seek  to  know  as 
much  as  possible  about  the  battlefield,  to 
"see  over  the  hill"  and  reduce  their  level 
of  uncertainty.  They  will  wish  to  control 
their  surveillance  devices  in  order  to  be 
certain  that  these  resources  work  on  the 
tasks  that  they  consider  important. 

39.  UAVs  offer  a  very  attractive  tool  for 
commanders  to  increase  their  level  of 
certainty.  They  allow  commanders  to  "see 
the  battlefield"  while  being  less 
expensive  than  an  equivalent  capability 
manned  aircraft.  UAVs  offer  commanders 
real  time  information,  often  in  an  easily 
absorbed  video  format.  Being  unmanned 
they  can  be  used  on  very  high  risk 
missions  and  a  lack  of  aircrew  onboard 
means  that  the  air  vehicle  can  be  smaller, 
improving  its  chances  of  survival. 

40.  UAVs  will  not  solve  all  problems  nor 
replace  manned  aircraft  for  all  roles  but 
they  do  offer  ground  commanders  a  valuable 
resource  at  relatively  low  cost. 

THE  OPERATIONAL  ENVIRONMENT  OF  IAMD_.UAVa 


Effect  of  Geography 
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41.  Land  based  military  operations  are 
heavily  influenced  by  the  geography  in 
which  they  occur.  The  widely  varying 
topography  and  cultural  overlay  mean  that 
the  type  of  terrain  available  for 
deployment  in  any  square  kilometre  is 
effectively  random.  Neither  senior 
commanders  nor  computers  can  accurately 
foresee  the  low  level  topography  that  the 
enemy  will  have  available  to  him.  It  is 
not  possible  to  fully  foresee  the  enemy's 
tactical  plan. 


42.-  The  random  nature  of  the  ground 
available  to  the  enemy  is  further  enhanced 
by  the  ground's  effect  on  line  of  sight 
(LOS) .  It  is  possible  to  understand  how  a 
particular  piece  of  ground  affects  the 
enemy's  deployment  without  understanding 
fully  the  effect  of  surrounding  terrain  on 
our  LOS  to  the  enemy  and  his  to  us. 


43.  The  enemy  can  hide  his  personnel  and 
equipment  under  terrain  features  as  well 
as  behind  them.  This  greatly  increases 
the  enemy's  ability  to  conceal  his  forces. 


44.  The  concealment  of feted  by  the 
terrain  is  further  enhanced  by  the  effects 
of  local  weather.  The  ground  effects  of 
local  terrain  means  that  weather  can  have 
unique  local  variations  such  as  fog  and 
mist  following  the  low  ground  while 
leaving  high  features  unobstructed. 

Can1  feliifid_Ef  feet 

45. -  The  concealment  opportunities  offered 
by  ground  mako  it  very  difficult  to  detect 
fully  the  enemy  force's  deployment  and 
surmise  its  intentions. 


46.  Geographical  factors  are  not  the  only 
ones  that  make  it  difficult  to  understand 
the  enemy's  actions  and  intentions.  The 
following  paragraphs  illustrate  how  the 
nature  of  modern  warfare  makes  it 
difficult  to  understand  the  enemy's 
posture. 

Ettast  at  Modern.  Weapons 

47.  The  most  obvious  tactical  influence 
is  the  destructiveness  of  modern  weapons,. 
The  power  of  modern  weapons  means  that 
exposed  personnel  and  unarmored  equipment 
have  little  chance  of  survival.  This  is 
of  great  importance  as  the  largest  portion 
of  land  forces  consists  of  unprotected 
men,  unarmored  vehicles  and  installations 
and  lightly  armoured  vehicles.  Both  sides 
will  disperse  their  forces  making  them 
less  evident  to  the  opponent. 


levels.  The  traditional  structure  of 
sections,  platoons,  companies  etc  is  not 
an  outdated  holdover  from  the  past. 

Rather,  it  represents  a  recognition  of  the 
number  of  subordinates  that  a  land 
commander  can  effectively  lead  in  a 
tactical  scenario.  These  commanders  have 
different  information  requirements.. 

Communication 

49.  Advances  in  modern  communications 
assist  high  level  commanders  in  their 
task.  Forces  can  be  dispersed  for 
survival  and  only  concentrated  when  and  to 
the  degree  neceosary  to  achieve  decisive 
local  superiority  over  th'!  enemy.  These 
improvements  have  not  led  to  greater 
centralization  of  command  due  to  the  fact 
that  as  technology  makes  communications 
more  effective,  it  makes  weapons  more 
lethal.  This  leads  to  the  need  for 
dispersal  and  requires  that  the 
traditional  hierarchial  structure  bo 
retained  to  bridge  the  gap. 


50.  The  use  of  aircraft  offers  a  means  of 
detecting  widely  dispersed  land  forces. 
Planes  can  cover  large  areas  in  a  short 
time  and  can  look  down  onto  the  ground, 
thus  obviating  the  effect  of  LOS. 

However,  a  number  of  factors  prevent 
aircraft  giving  commanders  a  complete  view 
of  the  battlefield.  Land  targets  are 
small  and  are  not  immediately  evident  to 
the  human  eye  or  other  airborne  sensors. 
Secondly,  the  effectiveness  of  tactical 
air  reconnaissance  is  reduced  by  ground 
based  air  defences.  These  systems  can  be 
highly  effective  and  deployed  under  local 
cover,  thus  making  them  very  hard  for 
pilots  to  detect.  It  is  easier  for  the 
ground  based  air  defence  systems  to  detect 
aircraft  that  are  silhouetted  against  the 
sky  than  it  is  for  the  aircraft  to  detect 
dispersed,  camouflaged  ground  systems. 

The  final  problem  is  the  fact  that  modern 
aircraft  cost  a  great  deal  of  money.-  It 
is  unlikely  that  large  numbers  of  aircraft 
will  be  available  for  air  reconnaissance, 
especially  when  it  is  believed  that  the 
enemy  has  a  capable  air  defence  systems. 
Commanders  will  not  wish  to  risk  scarce 
resources  to  carry  out  reconnaissance  of 
ground  targets  with  the  natural 
r  .ncealment. 

Simsaxy 

51.  Land  warfare  involves  a  large  number 
of  small  elements,  dispersed  throughout 
the  available  terrain,  seeking  to  remain 
unobserved  and  working  as  part  of  a 
coordinated  team  with  commanders  at  a 
necessarily  low  level.  This  makes  it  very 
difficult  for  commanders  to  be  able  to  see 
the  battlefield.  They  must  devote  a  great 
deal  of  thought  and  effurt  to  obtaining 
often  the  most  elementary  information 
about  the  enemy's  forces,  deployment  and 
intentions. 


48.  All  the  above  factors  mean  that  it  is 
impossible  to  command  large  numbers  of 
soldiers  directly.-  To  address  this 
problem,  armies  use  a  number  of  command 


52.  The  levels  of  command  within  an  army 
have  corresponding  areas  of  influence  and 
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interest  which  generally  define  the  type 
of  UAV  support  required..  Commanders 
become  less  directly  involved  with 
immediate  operations  as  the  level  of 
command  increases.  The  doctrinal  time  and 
space  considerations  for  brigades, 
divisions,  and  corps  are  given  in  Table  1. 


53.  As  a  rule,  a  commander  will  actively 
seek  information  and  engage  the  enemy  in 
his  area  of  influence.  Information 
concerning  his  area  of  interest  is 
provided  by  his  superior.  The 
Interlocking  areas  of  influence  and 
interest  impose  unique  requirements  on  UAV 
systems  operated  at  each  level. 


LEVEL  AREA  AREA 

of  or  OF 

COMMAND  INTEREST  INFLUENCE 


TIME  fH) 

DISTANCE  ,KM) 

TIME  fH) 

DISTANCE  f  KM) 

CORPS 

0-96 

300 

0-72 

150 

DIVISION 

0-72 

150 

0-24 

70 

BRIGADE 

0-24 

70 

0-12 

15 

Table  1 

Typical  Areas  of  Interest  and  Influence 


Brigade  Level 

54.  At  this  level  the  prime  UAV  role  is 
surveillance  and  target  acquisition  to 
provide  early  warning  of  enemy  activity.; 
Although  a  brigade  has  limited  indirect 
fire  support,  there  will  be  some 
requirement  to  engage  targets  beyond  the 
line  of  sight  of  its  forward  sub-units. 

The  requirements  at  this  level  include: 

a.  A  high  daily  sortie  rata  to 
support  continuous 
operations; 

b.  High  quality  imagery  and 
rapid  imagery 
interpretation  to  provide 
timely  information; 

c.  Small  UAV  infrastructure  in 
order  to  impose  the 
minimum  burden  on  the 
supported  brigade;  and 

d.  Ground  based  components 
must  have  similar  mobility 
and  survivability  to  that 
of  the  brigade's  other 
units. 

Eiyifilen_i£X£i 

o5.  The  division  has  several  functions 
which  can  be  enhanced  through  the  use  of 
UAVs.  Target  acquisition  and  fire 
direction  by  UAVs  will  allow  a  division 
commander  to  attack  enemy  formations 
before  they  are  engaged  by  his  subordinate 
brigades..  Other  possible  tasks  include 
providing  an  elevated  electronic  warfare 
platform,  conducting  chemical  warfare 
reconnaissance  and  collecting  target  area 
meteorological  data.  These  varied  tasks 
raise  the  issue  of  a  multi-role  UAV,  some 
of  the  requirements  for  which  are: 

a,.  Well  defined  and  practised 
command  and  control 
procedures  to  keep  UAVs 
employed  on  most  important 
tasks; 


b. .  Modular  payloado  to  cater 

to  various  tasks; 

c.  Well  designed  Ground 
Control  Station  (GCS)  to 
reduce  operator  workload 
and  to  enable  use  of 
different  payloads; 

d. ;  UAV  systems  capable  of 

integration  with  other 
information  gathering  means 
to  ensure  effective  and 
efficient  employment;  and 

e.  Ability  to  conduct  target 
engagements  with 
indirect  fire  to  maximize 
the  effect  of  long  range 
weapons. 

Corps  Level 

56.  At  this  level  information  gathered  by 
UAVs  can  be  les3  time  critical  than  at 
lower  levels.  Target  acquisition  will 
still  be  carried  out,  but  the  engagement 
of  all  targets  found  might  be  beyond  the 
capability  of  the  corps'  fire  support 
resources.  The  collection  of  both  imagery 
and  electronic  information  will  be 
important  tasks  to  support  corps  level 
planning  of  future  operations.-  Some 
requirements  which  arise  from  the  corps' 
role  and  its  time  and  space  considerations 
are: 

a. -  Range,  endurance  and  speed 

required  to  operate  in  the 
enemy's  rear  areas  will  be 
much  greater  than  that 
required  by  divisions  and 
brigades; 

b.  A  more  sophisticated  air 
vehicle  will  probably  be 
required  for  corps  level 
use.  Supporting  a  more 
sophisticated  UAV  will 
increase  the  infrastructure 
cost.  The  benefit  of 
employing  a  more 
sophisticated  system  at 
this  level  will  justify 
this  cost;  and 
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c..  The  ability  of  a  corps 
level  system  to  provide 
vast  amounts  of  raw 
information  will  require 
increased  exploitation 
resources  in  order  to 
quickly  extract  the 
required  information. 


IV.  DIFFICULTIES  IK  USING  PAYS 

57.  UAVs  do  not  solve  all  problems.  The 
problems  that  can  be  encountered  and  an 
idea  of  what  must  be  done  to  address  them 
will  be  discussed  in  the  following 
paragraphs. 


58.  Given  that  land  forces  are  scattered 
throughout  large  areas  of  terrain,  armies 
will  not  be  able  to  purchase  enough  UAVs 
and  support  personnel  and  equipment  to 
give  them  full  knowledge  of  their 
opponent's  deployment.  The  smaller  naval 
Task  Group  will  not  require  the  same 
number  of  UAVs  to  accomplish  it  missions. 
The  UAVs  that  are  purchased  must  be  used 
to  maximum  effect  in  support  of  the 
commander's  requirements. 

59.  Armies  will  want  to  have  a  suite  of 
UAVs  that  are  matched  to  the  requirements 
of  the  various  command  levels.  Navies 
will  prefer  a  common  UAV  with  multi¬ 
mission  payloads.  Decentralised  use, 
probably  by  the  allocation  of  a  number  of 
sorties,  to  those  agencies  that  the 
commander  feels  have  a  bona  fide 
requirement  for  UAV  sorties  would  allow 
the  control  necessary.  This 
decentralisation  would  be  supported  by  the 
commander's  retention  of  a  reserve  of 
sorties;  these  would  be  used  for  urgent 
priority  tasks  and  to  give  the  commander 
some  flexibility  giving  him  a  reserve  of 
uncommitted  resources  that  he  can  use  to 
cater  to  the  unexpected. 

fO.  This  system  of  sortie  allocation 
requires  that  a  good  chain  of  command  for 
tasking  the  UAV  operators  exists.  Good 
command  and  control  procedures  must  be  in 
place  to  ensure  that  UAV  taskings  are 
handled  consistently,  effectively  and 
quickly,  while  ensuring  that  information 
from  one  tasking  is  available  to  all  users 
as  required. 

Management  of  InforroaUian...F.lg« 

61.  This  dissemination  of  information 
should  save  taskings  as  some  users  can  get 
the  information  they  require  from 
previously  flown  sorties.  In  the  Army 
environment,  ensuring  that  the  proper 
information  gets  to  the  people  who  need  it 
rn  a  timely  fashion  is  no  small 
accomplishment.  One  UAV  mission  could 
generate  several  hours  of  video  tape. 

This  must  analysed  and  disseminated 
before  the  information  becomes  stale.. 
Further,  the  information  system  must 
ensure  that  users  are  not  swamped  with 
unnecessary  information.  The  use  of  data 
fusion  and  wide  area  computer  networks 
seem  like  obvious  technologies  for 


resolving  these  problems.  They  cannot  be 
the  entire  solution.  A  clear 
institutional  understanding  of  UAV 
operations  is  necessary  so  that  the 
ongoing  information  needs  of  all  agencies 
and  the  real  significance  of  information 
acquired  is  known.  Everyone  must  know 
which  piece  of  knowledge  contributes  the 
most  to  the  commander's  plan  of 
operations,  the  discovery  of  a  fuel 
storage  site  or  100  tanks  found  in  reserve 
six  hours  behind  the  enemy's  apparent  main 
axis.  Resources  are  limited  and  it  will 
not  be  possible  to  shoot  at  every  target, 
therefore  the  important  ones  must  be 
engaged  first. 

62.  The  Naval  UAV  system  will  be  linked 
directly  into  the  Combat  system  of  the 
ship.  The  ship's  Combat  System  will 
conduct  the  required  data  fusion  and 
distribution.  Individual  operators  and 
Warfare  Commanders  can  access  the  data 
they  require  from  the  tactical  data  base. 

63.  Purchasing  UAVs  without  implementing 
the  necessary  change  in  procedures  and 
doctrine  will  not  obtain  the  full  results 
possible.  An  army  that  does  this  may  be 
reduced  to  doing  the  "same  old  things"  in 
a  different  way  rather  than  making 
significant  improvements  in  reducing  its 
commanders'  degree  of  uncertainty.  In 
fact,  euch  an  introduction  of  UAVs  may 
actually  increase  commanders'  uncertainty 
by  inundating  them  with  clear,  real  time 
information  that  is  irrelevant.; 


64. -  Closely  related  to  the  abova 
mentioned  points  are  the  problems  that  can 
arise  when  armies  have  to  decide  exactly 
what  their  UAVs  are  to  do  on  each  mission.- 
This  problem  ie  particularly  severe  for 
multi-role  UAVs;  which  is  more  important,, 
surveillance  or  using  the  UAV  with  an 
electronic  jamming  pod  to  disrupt  the 
enemy's  rear  area  communications?  Even 
with  a  single  role  surveillance  UAV  the 
decisions  are  not  necessarily  obvious.  Is 
it  better  to  do  a  wide  area  surveillance 
mission  to  obtain  new  information  or  uee 
the  UAV  as  an  airborne  observation  post  to 
direct  fire  onto  targets  that  have  already 
been  identified?  During  sirveillance 
missions  when  should  UAVs  stop  and  attack 
targets  by  directing  artillery  fire? 

65. :  Clearly,  the  UAVs  muit  be  used  to 
support  the  commander's  "><m.  This  simple 
statement  is  not  always  easy  to  apply  to 
hard,  real  life  choices.  Therefore,  UAV 
doctrine  and  staff  and  command  training 
must  educate  officers  about  these  problems 
in  order  to  reduce  errors  in  the  heat  and 
confusion  of  battle.. 

V.  A  TYPICAL  UAV  SYSTEM 

66.  The  main  elements  ol  any  UAV  system 
are:' 

a.  command  and  Control  element; 

b.  Ground  Control  Stations; 

c. -  Support  Element;  and 
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d.  UAVs  and  Payloads. 


Command  and  Control 

67.  Effective  command  and  control  is 
vital  if  the  full  potential  of  UAVs  is  to 
be  realised.  The  following  list 
illustrates  the  coordination  required  to 
conduct  effective  UAV  operations: 

a.  Provision  of  Advice  on  UAV 
Employment,  uav 
limitations  must  be  made 
known  early  to  ensure 
optimum  employment  of  a 
scarce  resource; 

b.  Coordination  Wlth_QtMr 
Surveillance  Systems.  UAVs 
are  one  element  of 
complementary  systems . 

They  must  take  full 
advantage  of  cuing 
information  provided  by 
other  systems; 

c.  Airspace  Coordination.  The 
integration  of  UAVs  with 
other  aircraft  would 
require  the  adoption  of 
special  airspace 
requirements  for  the 
conduct  of  safe  UAV  flight. 

It  is  likely  that  manned 
aircraft  and  UAVs  would  fly 
simultaneously.  The 
maintenance  of  safe 
separation  distances 
between  all  types  of  air 
vehicles  is  essential.-  In 
so  far  as  is  practical,  the 
use  and  control  of  UAVs 
would  be  the  same  as  for 
manned  aircraft.  The 
control  of  emissions  from 
the  UAV  would  follow  as 
closely  as  possible  the 
established  procedures  and 
governing  directives  for 
other  aircraft  operating  in 
the  same  task  group; 

d.  Fire  Support  Coordination. 

In  both  the  sea  and  land 
environments,  UAVs  require 
well  understood  and 
rehearsed  frre  control 
procedures  to  be  an 
effective  fire  direction 
tool.  Fire  units  and 
ammunition  must  be  made 
available  to  engage  targets 
located  by  a  UAV; 

elements  will  have  unique 
siting  requirements. 

Commanders  and  staffs  must 
understand  t*'  ,se  so  that 
they  can  make  balanced 
judgements  on  terrain 
control;  and 

f.:  Administration.  Land  UAV 

elements  spread  throughout 
a  formation's  area  require 
a  central  agency  to  control 
administration  to  ensure 


continuous  support  to  UAV 
operations . 

Ground  Control  Stations 

68.  The  GCS  performs  detailed  planning 
and  minute  to  minute  control  of  UAV 
missions.  A  major  factor  in  GCS 
performance  will  be  operator  fatigue. 
Continuous  operations  will  require 
multiple  crews  to  keep  a  GCS  running 
effectively.  A  multi  role  system  could 
compound  the  manning  problem  by  requiring 
many  unique  skills  in  which  a  GCS  crew 
will  have  to  remain  proficient.  A  ground 
based  UAV  will  be  physically  separated 
from  both  its  command  and  control  element 
and  from  the  users  of  UAV  provided 
information.  A  crew  of  two  and  perhaps 
three  personnel  will  be  required  in  this 
case  to  both  control  the  UAV  and  conduct 
the  assigned  mission.  Sea  based  systems 
do  not  suffer  this  problem  as  specialist 
operators  are  present  in  the  ship  to 
support  analysis  of  UAV  data.-  The  obvious 
requirement  in  general  terms  is  to 
automate  the  GC3  to  such  a  degree  that  a 
human  operator  can  devote  the  bulk  of  his 
time  to  analysing  information  and  making 
decisions  while  only  being  required  to 
master  a  few  skills  in  order  to  operate  in 
the  GCS  environment. 


Support  Element 

69. :  The  Support  Element  is  primarily 
concerned  with  keeping  the  UAV  and  payload 
inventories  serviceable.  High  usage  rates 
and  attendant  maintenance  requirements  are 
directly  at  odds  with  the  need  to  reduce 
infrastructure.  Highly  reliable  and 
easily  maintained  UAVs  are  required. 

y&Ys  and...Paylpafla 

70.  UAVs  are  essential  to  a  UAV  system. 
However,  the  real  value  of  UAVs  is  not  in 
a  great  airframe  or  sensor  but  rather  in 
how  the  operators  employ  their  UAV  to 
support  a  commander's  pirn.  UAVs  and 
their  payloads  must  be  robust  to  survive 
field  handling.  They  must  have 
performance  and  survivability 
characteristics  sufficient  to  face  the 
expected  threat.  However,  neither  the 
airframe  nor  the  sensor  can  become  so 
precious  that  their  loss  would  be 
unacceptable.  While  not  throw-away  items, 
UAVs  and  their  payloads  are  built  to  go 
into  dangerous  places  to  protect  manned 
aircraft.  Losses  to  a  units  UAV  inventory 
must  be  seen  as  inevitable  and  UAV  design 
must  keep  this  in  mind. 


71.  Having  looked  at  the  nature  of  sea 
and  land  warfare,  operational  concepts, 
methods  of  employing  UAVs  and  the  problems 
associated  with  such  employments,  a  number 
of  differences  become  clearer.-  These  are 
summarized  in  Table  2  below. 

73.  No  single  system  will  meet  both  the 
land  and  sea  requirements.  The  overall 
benefit  of  UAV's  is  however  well 
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recognized  in  both  communities.-  Future 
Orders  of  Battle  will  undoubtably  find 
UAV's  figuring  prominently  among  land  and 
sea  commanders  "Tool  Boxes". 

SEA 

LAND 

a. 

No  or  limited 
terrain  features 
(coastlines) ; 

Varied  terrain  features; 

b. 

Centralized 
command  structure 
involving  a  small 
number  of 
individual  units; 

Decentralized  hierarchial 
command  structure  involving 
many  small  groups; 

c. 

small  number  of  end 
users  of  UAV  data; 

large  number  of  end  users 
each  with  differing  levels 
of  requirements; 

d. 

limited  number  of 
commun' cation  and  c3 
nets; 

extensive  communications 
and  c3  nets; 

e.- 

Large  platforms  result 
in  fewer  restrictions 
on  UAV  system  space 
and  weight; 

Smaller  platform  will 
restrict  UAV  system  space 
and  weight; 

f . 

Vertical  takeoff  and 
landing  is  essential; 

Vertical  takeoff  and 
landing  desirable; 

g-. 

Single  UAV  airframe 
with  multi-mission 
payloads;' 

MULTISENSOR  AIRBORNE  TARGET  ACQUISITION  SYSTEMS 
AND  THEIR  INTEGRATION 
by 
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Dr.  J.W.  Jack 

Electro  Optic  Systems  Group 
Navigation  Systems  Division, 
GEC  Ferranti, 
EDINBURGH 


t.  THE  TASK 

For  the  air  to  ground  attack  scenario,  the  task  of  electro  optic 
sensors  is  to  optimise  the  process  of  target  acquisition  and  the 
subsequent  delivery  of  a  weapon  to  that  target. 

The  increasing  range  of  enemy  defence  continues  to  demand 
greater  detection,  recognition  and  identification  ranges.  Thrgets 
frequently  have  low  signatures  and  the  atmosphere  may  further 
reduce  target  contrast.  Developments  in  camouflage  and  counter 
measures  increase  the  difficulty  of  carrying  out  an  already 
demanding  task  from  a  low  flying  high  performance  airborne 
platform  under  all  weather  conditions  ana  during  daylight  or  at 
night.  One  solution  has  been  to  equip  the  attacking  aircraft  with 
imaging  sensors  which  aid  the  search  task  by  presenting  to  the 
crew  a  magnified  image  of  the  scene  on  a  television  style  monitor 
in  the  cockpit.  Initially  such  sensors  «  baaed  on  visible 
wavelength  television  and  were  therefore  daylight  opera  tion  only. 
These  have  now  been  extended  to  the  infra-red  region  giving  a 
twenty  foui  hour  and  all  weather  capability.  Enemy  forces  have 
responded  to  the  use  of  such  sensors  by  developing  visible 
wavelength  camouflage  and  later  by  developing  IR  counter 
measures,  white  at  the  same  time  increasing  the  effectiveness  of 
their  defences.  Thus  the  demands  on  the  sensor  for  higher  spatial 
resolution  and  greater  sensitivity  have  increased  simultaneously 
from  a  reduction  in  target  characteristica  and  a  need  for  increased 
stand-off  range  capability. 

There  h  a  also  been  a  demand  for  more  accurate  weapon  delivery 
and  this  has  resulted  in  the  development  of  smart  weapons  This 
provided  increased  requirements  for  the  acquisition  equipment 
which  must  now  also  be  capable  of  handing  over  a  target  'o  a 
weapon  or  of  designating  it  with  a  laser  beam  up  to  impact. 

A  great  deal  of  work  has  been  carried  out  over  the  past  twenty 
years  in  the  development  of  equipment  to  provide  large! 
acquisition  and  accurate  User  designation.  GEC  Ferranti  has 
been  involved  in  the  development  of  such  equipment  over  this 
period  of  time  and  has  been  responsible  for  the  design  and 
fabrication  of  equipment  which  provided  very  accurate 
designation  of  small  mobile  targets  from  an  airborne  platform 
This  has  been  reported  at  a  previous  Agard  Conference 
(Reference  1).  It  is  essential  to  integrate  these  syslems  into  the 
avionics  and  to  optimise  the  man  machine  interface  in  order  to 
achieve  the  full  potential  increase  in  performance.  GEC  Ferranti 
has  also  earned  out  work  to  investigate  the  crew  workload  and 
look  at  ways  in  which  this  may  be  minimised  (Reference  2) 
Current  capability  is  therefore  the  result  of  many  years  of  careful 
development  and  advancement. 

2  INHERENT  LIMITATIONS 

The  performance  of  any  sensor  system  is  constrained  by  the 
inherent  physical  properties  of  the  system.  The  following 
discussion  is  confined  to  sensors  operating  essentially  as  imaging 
devices  in  the  visible  and  infra-red  regions  of  the  electromagnetic 
spectrum. 

The  angular  resolution  ideally  achieved  with  an  imaging  sensor 
system  is  limited  by  optical  diffraction  effects  and  in  its  simplest 
approximation  the  resolution  can  be  taken  to  be  proportional  to 
the  ratio  of  the  wavelength  of  the  radiation  to  the  aperture  of  the 
receiver.  In  order  to  achieve  a  compact  system,  the  wavelength 
chosen  must  be  small.  Use  of  wavelengths  tn  the  visible  and 


infra-red  region  result  in  both  high  resolution  and  small  aperture 
The  latter  characteristic  is  particularly  important  when  the 
constraints  imposed  by  the  airborne  platform  are  taken  into 
account. 

The  other  major  factor  which  influences  the  choice  of  wavelength 
is  the  overall  system  sensitivity  This  is  determined  by  the  energy 
radiated  from  the  target,  the  atmospheric  attentuation  in  the  path 
between  the  te.get  and  the  sensor  and  the  performance  of  the 
sensor/dispiay/ci,«rator  combination.  Sensors  operating  in  the 
visible  and  IR  wavebands  arc  normally  passive  devices  which  rely 
on  natural  illumin  reion  or  the  natural  radiation  from  the  scene. 
Pi-ssive  sensors  arc  preferred  for  military  applications  since  covert 
operation  is  normally  an  essential  requiremei  to  avoid  detection 
and  thereby  reduce  the  probability  of  counter  measures  being 
deployed.  There  are  a  limned  number  of  transmission  ■‘windows” 
in  the  atmosphere,  the  three  most  useful  being  visible,  3  to  5 
microns  arid  8  to  I  f  microns.  These  are  shown  in  Figure  1.  There 
are  a  limited  number  of  sensors  currently  available  to  explo  i  these 
windows  Of  these  the  visible  region  and  8  to  14  micron  imagers 
have  to  dale  the  belter  performance  for  scene  imaging.  However 
recent  developments  in  3  to  5  micron  imaging  may  change  this  in 
the  near  future. 


FIGURE  I  :  ATMOSPHERIC  ATTENUATION 

Ttlrvision  sensors  have  been  developed  over  the  last  50  years  and 
haic  reached  a  high  slate  of  maturity  and  performance  They 
operate  over  the  visible  region  and  into  the  near  IR  in  some  cases, 
and  can  cope  villi  a  wide  dynamic  range  of  scene  illumination 
levels  Options  it  for  using  restricted  regions  of  the  waveband 
in  order  to  enhance  the  performance  in  haze  and  under  low  levels 
of  scene  illumination  The  properties  of  natural  and  man  made 
materials  also  suggest  lhal  a  bias  towards  Ihe  red  end  of  the  visible 
spectrum  will  aid  Ihe  distinction  between  a  camouflaged  largcl 
and  naturally  occurring  vegetation.  The  reflectance  of  a  variety 
of  natural  ground  cover  is  shown  in  Figure  2.  Imagers  operating 
in  Ihe  8  to  14  micron  region  have  been  under  development  for 
a  much  shorter  period  and  have  only  recently  reached  a  form  of 
maturity.  The  performance  of  both  types  of  sensor  is  well 
understood  and  performance  models  are  red  extensively  for 
predicting  operational  performance.  Atmospheric  effects  are 
also  understood  and  may  be  accurately  modelled  using,  for 
example,  Lowtran. 

3.  PERFORMANCE 

It  is  necessary  lo  establish  some  qualitative  measure  of 
performance  in  order  lo  justify  the  choice  of  sensors  for  a 
multuensor  payload  In  a  full  TV/IR  comparison  the 
recommended  approach  is  to  make  laboratoty  measurements  on 
the  performance  of  each  under  well  controlled  conditions  and 
compare  Ihe  data  for  what  are  considered  similar  inputs  to  each 


9-2 


system.  This  is  followed  by  a  controlled  flight  test  programme 
against  bar  targets  and  aciual  targets  to  confirm  the  predictions 
of  the  model.  Finally  an  extensive  flight  trial  should  be  earned 
out  to  investigate  those  conditions  which  favour  one  system.  This 
would  require  testing  against  a  total  set  of  all  conditions  and  in 
a  worldwide  context  is  clearly  impractical.  Thus  predictions  based 
on  a  subset  of  all  conditions  must  be  made. 


FIGURE  2 :  VEGETATION  REFLECTANCE  VALUES 

One  may  select  recognition  range  as  a  sensor  performance 
parameter  and  calculate  this  value  for  the  two  sensors  under  a 
wide  range  of  conditions.  Performance  models  exists  which 
enable  this  calculation  to  be  made  with  good  accuracy  and  allow 
valid  comparisons  to  be  made.  Each  condition  must  be  idennfit  d 
by  the  atmospheric  conditions,  target  parameters,  background 
and  lime  of  day.  These  parameters  can  vary  widely  during  the  year 
for  the  majority  of  toe.  ions  on  the  earth’s  surface  The 
atmospheric  attentuatior.  «  known  to  be  dependent  on  the 
moisture  content  of  the  atmosphere  but  it  is  necessary  to  know 
the  characteristics  of  the  atmospheric  moisture  before  computing 
the  attenuation.  Certain  aerosols  can  have  a  severe  impact  on  T1 
performance  while  hardly  affecting  TV  performance. 

It  is  also  necessary  to  define  the  characteristics  of  the  target 
adequately  and  to  take  account  of  the  correlation  between  these 
characteristics  and  those  of  the  atmosphere.  There  is  obviously 
a  relationship  with  the  time  of  day  and  the  time  of  year 

As  an  example  of  the  range  of  predicted  performance  that  can  be 
expected  to  occur  in  reality,  two  locations  have  been  selected  for 
a  comparative  performance  assessment  Both  are  in  the  Gulf 
Region.  One  location  is  a  typically  hot  and  dry  semi  dcseri 
scenano  and  the  second  is  >  hot  and  humid  coastal  scenario  The 
target  was  defined  to  consist  of  a  concrete  block  of  five  metre  edge 
against  semi  desert  for  the  first  location  and  against  coastal 
vegetation  for  the  second  location.  Data  was  collccled  over  a 
period  of  time  on  an  hourly  basis.  Performance  was  calculated 
on  an  hourly  basis  and  then  analysed  This  was  felt  to  be  more 
realistic  than  averaging  the  data  and  calculating  the  performance 
based  on  the  average  conditions.  The  atmospheric  attenuatio , 
was  computed  using  the  Lowtran  atmospheric  model  and  the 
target  characteristics  and  recognition  range  computed  using 
in-house  models. 

The  results  are  shown  in  F  gure  3  for  the  hoi  dry  location  and 
Figure  4  for  the  hot  humid  location.  These  results  should  be 
viewed  as  a  sample  of  performance  over  several  days  at  a 
particular  time.  They  show  that  at  the  hot  dry  location  the  TV 
sensor  was  slightly  better  d  mag  the  morning  and  that  at  the  hot 
humid  location  the  TV  sensor  was  better  during  the  daylight 
period.  Obviously  the  TV  performance  goes  to  zero  between  dusk 
and  dawn 
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FIGURE  3  :  PERFORMANCE  HOT  DRY  LOCATION 
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FIGURE  4  :  PERFORMANCE  HOT  HUMID  LOCATION 

Or.e  may  conclude  that  the  extra  performance  achieved  from  the 
Iwo  sensor  system  is  worth  the  extra  cost  of  providing  the  second 
imaging  sensor.  The  'll  imager  would  be  Ihe  obvious  choice  as 
the  prime  imager  but  there  are  occasions  when  the  TV  shall 
provide  enhanced  recognition  range  The  ability  to  switch 
between  sensors  when  in  the  target  area  can  obviously  bnng  a 
considerable  advantage  to  the  multisensor  equipped  aircraft. 

It  is  also  pertinent  to  considei  if  the  information  from  both 
sensors  may  be  combined  or  fused  in  a  manner  which  will  provide 
the  operator  wilh  a  single  image  containing  Ihe  most  relevant 
features  from  bolh  channels  A  variety  of  schemes  exist  to  carry 
out  such  combining  This  has  been  invesngated  in  our 
laboraiories  and  a  variety  of  simple  super  position  schemes  tried 
The  results  are  described  below 

4.  HARDWARE  DESCRIPTION 

The  multisensor  equipment  has  been  configured  as  a  Pod  for 
simple  carriage  on  Ihe  underside  of  an  aircraft  A  photograph  of 
me  Pod  is  shown  in  Figure  5  and  Ihe  major  parameters  are  shown 
in  Figure  6.  There  are  five  major  subsystems,  Thermal  Imager, 
Television,  Laser  Rangefinder  and  Designator,  Thacker  and 
Sightlinc  Control. 

The  major  elements  of  the  front  end  of  the  Pod  are  shown  in 
Figure  7  Combining  optics  coiled  and  direct  the  three  sighllmes 
onto  a  two  axis  stabilised  mirror  located  at  the  extreme  front  end 
of  the  Pod  The  combination  oplic  ci  nsists  of  ihe  main  objective 
group,  the  folding  mirror  and  stabilised  mirror  and  Ihe  external 
window  The  laser  path  is  combined  with  Ihe  TI  path  by  means 
of  a  beamsplitter  which  reflects  Ihe  laser  and  transmits  the  IR. 
The  TV  is  injected  into  the  combined  TI/Laser  optical  path. 
Extensive  use  is  made  ct  multispedral  optical  materials  to  permit 
efficient  optical  transmission  at  the  appropriate  wavelengths.  The 
entire  front  section  can  be  rolled  about  the  Pod  longitudinal  axis 
and  the  ball  may  be  driven  m  pitch.  The  combined  action  of  these 
two  independent  servos  enables  (he  sightlinc  to  be  steered 


FIGURE  J :  PHOTOGRAPH  OF  TIALD  POD  INSTALLER  ON  A  TORNADO  AIRCRAFT 
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through  a  large  field  of  regard.  A  two  axis  gyro  stabilised  platform 
provides  precision  stabilisation  of  the  sightline  against  vibration 
inputs. 
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FIGURE  6 :  TIALD  POD  MAJOR  PARAMETERS 

Ar  autoboresight  facility  accurately  aligns  the  tracker  datum  to 
tne  laser  boresight.  This  facility  can  be  used  during  flight  to 
maximise  the  laser/tncker  harmonisation  accuracy.  When  the 
autoboresight  function  is  selected  the  front  window  is  rotated  in 
pitch  so  that  the  sensor  sightlina  are  pointing  Aft  into  the  Pod. 
'"he  combined  laser/TI  sightline  is  transmitted  through  the 
er.tmal  window,  reflected  off  a  folding  mirror  and  focussed  by 
a  p.  nboloid  onto  an  absorbing  target  within  the  Pod.  The  laser 
is  f.icS  at  the  absorbing  target  causing  a  hot  spot  to  appear  on  the 
target  fltis  spot  is  observed  by  the  IT  and  any  error  between  the 
fl  sit/'  '»  graticule  and  the  hot  spot  is  detected  by  the  tracker 
The  tra.  r  measures  the  misalignment  and  stores  it  as  a 
correction or.  A  fraction  of  the  laser  energy  is  reflected  back 
int.  the  T\  -tunnel  to  permit  calibration  of  the  TV  sighttinc 
grain  etc  in  s  ?  -  tilar  manner. 

The  front  end  u  «  it  -d  to  eliminate  the  risk  of  contamination  and 
heat  i:  t  tv.'erec  na  an  air  to  air  heat  exchanger  to  an 
Em  ironmt  si’al  Con'  •  1  Unit  (ECU)  located  immediately  to  the 
reir  of  the  ,'toflt  see'  in.  The  rear  aection  cor.iins  several 
electronic  utvs  and  i  power  supply  units  and  is  cooled  by 
forced  air  fro"»  die  F..L  Access  hatches  in  the  external  skin 
permit  access  to  >11  ,;.e  internal  Line  Replaceable  Units. 

The  Thermal  Imagii  is  .ocat!.!  entirely  within  the  from  section 
and  comprises  the  ream  -t,  el<  tromo  unit  and  optics.  The 
scanner  and  electron!.',  tut  ba  r  J  an  the  UKTICMU  thermal 
imaging  programme  «..d  i..  mat  u'-tc'  tred  by  GEC  Sensors 
Detector  cooling  is  provided  '  v  a  .  -,tt  closed  cycle  cooling 
engine.  The  optica  p,  i.>a  a  held  *  view  change,  focus 
adjustment  and  image  c  <  ration  Automatic  thermal 
compensation  of  focus  is  pr  -  ■  d. 

The  TV  is  a  compact  solid  stater  '.I  unit  inanu  /lured  by  GEC 
Ferranti.  The  camera  is  fitted  >  a  ««j  -  '’■■id  of  view 
compound  lens  assembly  which  malc/rs  the  nan-y* '  -Id  of  view 
to  theTl.  The  optical  path  is  folded  by  means  of  a  yerr.  ope  and 
adjustable  mirror  and  injected  onto  the  common  stabilised .  irror 
at  the  front  end  of  the  Pod.  The  lens  co.iiaitw  a  uerw.on 
mechanism  which  is  servo  controlled. 

The  laser  rangefinder  and  designator  provides  both  ■  rget  inl¬ 
and  laser  energy  for  target  designation.  The  raw  be  -a  is 
expanded  within  the  laser  telescope  to  decrease  tie  br  o, 
diverge  nee  and  powet  density.  The  telescope  also  con  - -a.  a  focus 
mechanism  to  compensate  for  changes  in  tempeiatcre,  Iht 
objective  lens  of  the  telescope  and  the  folding  m  to  are  shared 
with  theTl.  This  ensures  maintenance  of  accura  r  iresighting 
and  is  ntcessaty  to  provide  a  compact  design.  Th.  aser  beam 
forms  the  primary  optical  boresight  of  the  Pod  anu  aligned  to 
the  gimbal  axes.  Codingofthe  laser  pulse  repet.’v.i  'eensures 


it  is  compatible  witi.  the  laser  guided  muntions  currently  in 
service 

The  tracker  is  an  automatic  dual  mode  device  which  operates  on 
video  from  11  or  TV.  It  calculates  yaw  and  pitch  errors  between 
the  target  and  the  tracker  boresight  and  outputs  these  to  the 
steering  servos.  Both  centroid  and  corre'ation  tracking  are 
available.  The  tracker  is  manufactured  by  British  Aerospace 
Dynamics  Division. 

Sightline  control  maintains  the  sightline  stable  against  vibration 
inputs  and  computes  the  correction  terms  to  be  applied  to  the 
gimbrl  servos  to  maintain  the  sightline  on  the  correct  target  point. 

S.  INTEGRATION 

The  Pod  maintains  the  sightline  accurately  on  the  target  point  by 
means  of  calculations  based  on  the  aircraft  position,  attitude  and 
velocity  vector.  In  order  to  ensure  the  highest  accuracy,  the 
computations  must  utilise  the  most  accurate  aircraft  related  data. 
Any  delay  between  measuring  the  aircraft  data  and  it  being 
available  to  the  Pod  can  rejult  in  degradation  to  the  performance. 
It  is  essential  that  the  system  u  fully  integrated  with  the  avionics 
and  that  the  data  transfer  is  managed  to  minimise  delays. 

A  possible  integration  scheme  is  shown  in  Figure  8.  ft  is  assumed 
that  the  aircraft  is  fitted  with  an  Avionics  Data  Bus  and  that  the 
Pod  is  attached  to  this  bus  Aircraft  data  can  then  be  transferred 
directly  from  the  INU  to  the  Pod  as  an  RT  to  RT  transfer.  Also 
shown  u  a  Bus  Interface  Unit  (BIFU)  which  interfaces  such 
commands  as  mode  control,  slew  control,  laser  fire  and  track 
which  are  operator  activated. 


FIGURE  8  ;  POSSIBLE  POD  INTEGRATION  SCHEME 

The  diagram  contains  a  CPS  and  it  is  felt  that  if  GPS  is  available 
and  properly  integrated  with  the  INU,  vety  accurate  target 
co-ordinates  may  be  made  available  to  the  Pod  for  initial  pointing 
When  alignment  errors  between  the  Pod  and  the  aircraft  are 
removed  by  suitable  harmonisation  procedures,  the  initial 
sightline  pointing  should  be  vety  dose  to  the  target  and  minimise 
the  need  for  aim  point  refinement.  This  is  a  very  important 
feature  in  the  minimisation  of  crew  workload. 

6.  RESULTS 

The  equipment  has  been  subjected  to  extensive  evaluation.  The 
performance  of  both  sensors  has  been  measured  under  well 
controlled  laboratory  conditions  Performance  for  similar  inpul 
conditions  iscomparable  The  television  sensor  provides  the  same 
magnification  as  the  thermal  imager  The  horizontal  field  of  view 
is  3.6'  but  because  additional  active  video  lines  are  provided  by 
the  television,  the  vertical  field  of  view  is  2  7  compared  to  2  4  ° 
..,r  the  T1  The  predicted  range  performance  in  the  narrow  field 
for  standard  conditions  and  for  a  defined  target  is  very  similar  for 
both  sensors  Controlled  (light  tests  have  been  earned  out  using 
bjr  targets  and  the  predictions  of  the  modelling  checked 

Flight  lesli'-;  against  c  variety  of  targets  covering  a  wide  range  of 
w.ather  cor./,;.  ,u  has  been  conducted  ov  i  several  months 
Remits  are  very  encouraging  and  show  ihe  value  ol  both  channels 
in  providing  complementary  performance.  Weather  conditions 
could  not  be  controlled,  however  ■  ituations  were  encountered  in 
which  TV  offered  belter  pcn,..~.  .ce  and  on  different  occasions 
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favoured  H  operation.  As  stated  earlier,  an  attempt  to  fly  against 
all  conditions  is  dearly  impractical  and  the  results  must  be 
accepted  as  reflecting  a  limited  subset  of  all  conditions. 

Two  examples  of  comparative  TV  and  H  video  are  shown  in  the 
photographs.  These  are  simultaneous  frames  taken  from  a  dual 
track  recording  made  doting  a  trials  flight  in  the  UK  The  first 
set,  Figures  9  and  10  shown  bridge  viewed  from  medium  altitude. 
The  n  frame  also  carries  HUD  symbology  which  was 
suf*timposed  on  this  channel  for  recording  purposes  only.  Both 
frame*  thow  similar  information. 

The  second  set,  Figures  11  and  12,  show  a  power  station  viewed 
from  lower  level.  Again  the  T!  channel  carries  HUD  symbology. 
In  this  case  differences  between  the  two  images  are  apparent 
Attention  maybe  drawn  to  the  two  storage  tanks  to  the  right  of 
centre  which  are  easily  visible  in  the  IT  frame  but  are  less  visible 
in  the  TV  frame.  Also  the  collection  of  boats  moored  in  from  of 
the  complex  are  much  more  easily  visible  in  the  TV  frame  than 
in  the  Tt  frame. 

As  mentioned  earlier,  various  video  super  position  schemes  have 
been  demonstrated  in  the  laboratory.  An  example  of  simple  video 
mixing  isshown  in  Figures  13  and  14.  These  framesare  the  result 
of  mixing  the  two  images  from  the  different  sensors.  Good 
registration  is  essential  for  such  a  scheme.  For  the  bridge  scene, 
the  result  does  not  appear  to  offer  any  particular  improvement. 
For  the  power  station  scene,  it  would  appear  that  the  information 
content  of  the  mixed  video  frame  is  greater  than  that  of  the 
separate  sensor  frames. 

7.  CONCLUSIONS 

This  paper  has  discussed  the  requirements  for  increased  sensor 
performance  and  suggested  that  one  solution  .nay  be  to  provide 


a  dual  sensor  capability.  The  difficulties  of  conducting  tests  under 
realistic  conditions  are  set  out  and  the  alternative  of  providing 
calculated  performance  based  on  recorded  weather  and  target 
data  suggested.  Based  on  modelling  for  two  locations  in  the  Gulf 
region  it  is  shown  that  TV  can  offer  major  advantages  in  hot 
humid  conditions.  An  equipment  providing  a  dual  sensor 
capability  is  described  and  the  results  of  carrying  out  trials  Dying 
in  the  UK  are  presented.  These  results  are  qualitative  for  the 
reasons  discussed  above  but  show  the  complementary  nature  of 
both  sensors  in  aiding  the  target  acquisition  and  aiming  task. 
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FIGURE  9  :  BRIDGE  FROM  TV  CHANNEL 


FIGURE  10  :  BRIDGE  FROM  TI  CHANNEL 


FIGURE  13  :  BRIDGE  TV  AND  TI  MIXED 


FIGURE  14  :  POWER  STATION  TV  AND  TI  MIXED 
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1.  SUMMARY 

We  have  developed  a  modular  signal  processor 
architecture  that  is  suitable  for  many 
applications  to  meet  real-time  requirements  and 
is  adaptable  to  multiple  uses.  This  generic 
modular  architecture  was  developed  and 
demonstrated  in  real-time  hardware  for 
representative  filters  and  a  target  detection 
algorithm.  Computer-aided  design  tools  were 
used  throughout  the  hardware  development.  An 
application-specific  integrated  circuit  (ASIC)  or 
other  custom  IC  implementation  can  be  used  for 
actual  production  hardware 

2.  INTRODUCTION 

Numerous  enhancement,  acquisition,;  tracking, 
and  classification  algorithms  have  been 
developed  for  imaging  weapons  systems  to  deal 
with  various  target  scenarios.  These  algorithms 
have  been  evaluated  in  laboratory 
environments,  but  are  computationally  intense 
and  require  complex  signal  processors  for  real¬ 
time  operation.  Using  imaging  1R  data  for  real¬ 
time  missile  guidance  requires  a  system  with 
very  high  data  rates,  low  power  dissipation,  and 
small  volume.  Gate  array  or  ASIC  technology  can 
transfer  these  designs  from  a  laboratory 
simulation  to  a  missile  processor  but  at  a  high 
cost  for  each  design.  New  requirements  and 
algorithms  are  continuously  being  developed 
that  require  costly  and  lengthy  redesign  of  signal 
processors.  Different  scenarios  often  require 
unique  algorithms  for  detection  and 
classification.  Increasing  funding  shortfalls 
preclude  independent  signal  processor 
development  for  every  missile  program, 

3.  OBJECTIVE 

Our  goal  was  to  design  and  demonstrate  an 
imaging  IR  signal  processor  architecture 
adaptable  to  a  variety  ot  applications.  The 


technical  concept  is  expandable  to  allow  for 
future  algorithm  and  IC  developments.  This 
approach  can  reduce  production  costs  with 
algorithms  embedded  in  adaptive  ASIC  designs. 
We  conducted  a  laboratory  demonstration  of  the 
signal  processor  using  real-time  video  inputs. 
The  resultant  demonstration  showed  the 
capability  of  a  modular  architecture  to  handle 
various  complex  imaging  IR  signal  processing 
algorithms  in  a  real-time  environment.  Real-time 
capability  is  necessary  to  evaluate  large  amounts 
of  imagery,  for  quantifying  algorithm 
performance,  and  in  testing  new  imagers.  More 
importantly,.  the  modular  processor 
demonstrates  that  these  algorithms  can  be  run  in 
real  time  and,  therefore,  offer  the  potential  for 
inclusion  in  future  weapons  systems 

4.  MODULAR  PROCESSOR 

4.1.  Signal  Processor 

Our  signal  processor  takes  a  standard  RS-170 
video  signal  from  an  IR  imager,  VCR,  or  other 
source,  digitizes  it,  processes  it,  and  converts  the 
signal  back  to  RS-170  video  for  display.  In 
typical  tests  the  VCR  is  used  to  supply  a  source 
of  video  imagery,,  and  to  display  processed 
results  simultaneously  with  the  original,  as 
shown  in  Fig.  1. 

4.2.  System  Architecture 

The  bus  architecture  is  a  high-speed  pipeline. 
More  compact  implementations  are  possible,  but 
the  design  we  chose  uses  a  modular  system 
constructed  for  our  prototype  on  standard  wire- 
wrap  cards,-  one  card  for  each  processing 
algorithm.  The  flexibility  of  this  modular  design 
allows  evaluation  of  several  different  algorithms 
and  expansion  capability  for  future  functions. 
Two  types  of  pipelines  were  used,  a  simple  one 
with  very  little  overhead  for  each  module  and 
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Fig  1  Typical  test  setup 


12-2 


Vid*o«i 
RS  170 


Digitizer 

- - - \ 

_ N 

!___  _ * 

Module 

Module 

- X 

Module 

-  9  8  MHz 

H3 

•"mm! 

- K 

ereia  f™*'"  Bta'*"’ii> 

Tatitso  c«r 

- ✓ 

Fig  2.  Simple  pipeline  system 
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Fig,  3,  Distributed  pipeline  system. 


maximum  processing  speed  (Fig  2),  and  a  more 
flexible  interface  (Fig.  3)  using  first-in  first-out 
(FIFO)  buffers  and  reduced  data  lines  (9  bits 
versus  33).  The  second  design  distributes  the 
video  timing  and  address  generation  to  the 
modules  that  require  it,  but  saves  the  transfer  of 
that  information  between  modules. 

Both  schemes  were  used  in  brassboard 
processors  and  fully  tested.  The  distributed 
design  required  two  additional  ICs  per  module 
for  interfacing.  The  two  ICs  are  a  FIFO  memory 
chip  and  a  programmable  array  logic  (PAL)  chip. 
Both  of  these  chips  use  CMOS  technology,  have 
small  power  requirements,  and  take  up  little  real 
estate.  Using  these  two  chips  in  tandem  enabled 
us  to  reduce  the  necessary  control  logic  to  one 
bit  This  process  required  only  a  9 -bit  data  bus 
(8  bits  of  data  and  1  bit  for  control).  Advantages 
of  the  fully  distributed  system  include  fewer 
interconnections  between  modules,;  transfer 
rates  between  modules  limited  only  by  FIFO 
speeds,  simpler  module  designs,  and  completely 
asynchronous  timing.  The  advantage  of  using 
FIFOs  is  that  data  transfer  rates  are  limited  onlv 
by  the  cur'  it  FIFO  technology  FIFO  speeds  and 
capacities  increased  200  to  400%  in  the  last  year 
(currently  20  to  50  megahertz  (MHz)).  This 
design  can  be  used  in  a  variety  of  different 
speed  imaging  IR  signal  ptocessing  systems 
because  no  set  system  data  rate  exists  As  future 
algorithms  increase  in  complexity,  asynchronous 
timing  for  each  module  ensures  that  the  module 
implementing  the  algorithm  can  increase  its 
processing  speed  without  regard  to  other 
modules. 

4. 3. Distributed  Power 

Both  schemes  use  a  distributed  power  system 
with  voltage  regulation  and  conversion  handled 
locally  by  each  module.  Distributed  power 
greatly  simplifies  expansion  of  the  system  as 
modules  can  have  unique  requirements  for 
voltages,  power,,  noise,  and  reliability.  A  central 
supply  could  not  be  designed  to  handle  any  and 
all  features  that  an  added  module  might  need. 
The  power  busing  also  is  greatly  simplified  as 


less  current  is  needed  at  higher  voltages  and 
only  two  voltages  need  to  be  distributed. 
Because  the  system  load  is  partitioned,  a  failure 
in  one  converter  affects  only  that  portion  of  the 
system,  has  limited  impact  on  total  performance,; 
and  provides  weight  and  cost  savings.  Redundant 
power  sources  can  be  added  for  critical  functions 
without  the  significant  cost  and  weight  penalties 
for  a  redundant  central  power  system  A  central 
bulk  power  supply  cannot  respond  to  fast 
changes  in  load  requirements  on  a  large  power 
bus;  distributed  converters  can  The  quality  of 
distributed  power  is  kept  clean  by  isolating  each 
module  or  subsystem  and  by  using  separate 
power  and  ground  planes 

5.  MODULES 

We  built  a  total  of  1 1  different  modules 
including  a  digitizer  and  a  display  module  for 
each  of  the  two  system  architectures  We 
implemented  several  image  enhancement 
techniques  to  improve  image  contrast  and 
content  for  a  human  observer  (Ref  1),  and 
implemented  a  target  detection  technique  (Ref  2) 
in  a  module.  Future  plans  are  to  design  and 
fabricate  a  tracking  module 

5.1.,  Digitizer 

One  basic  function  necessary  to  process  imagery 
digitally  is  to  digitize  the  image.  The  incoming 
video  signal  (from  IR  imager  or  VCR)  is  digitized 
,o  8  bits  and  512  pixels  per  line  This  resolution 
determines  the  system  clock  rate  of  9  8  MHz 
(Equations  1  and  2). 

(1/(30  frames/s  x  525  lines/frame))  -  11.1  ps 
blanking  =  52.1  ps  active/line  (I) 

(512  pixels/line)/(52.1  ps  active/line) 

=  9.8  MHz  (2) 

More  precise  digitization  is  unnecessary  in  most 
applications  because  a  human  operator  can 
distinguish  only  6  to  7  bits  of  grey  level  on  a 
video  monitor  (Ref  3)  Digitizing  is  performed  by 
a  hybrid  analog-to-digilal  (A/D)  converter. 
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Analog  Devices  AD9502,  which  will  accept  RS- 
170  video  directly.  Fast  CMOS  logic  is  used  to 
convert  the  sync  signals,  supplied  by  the 
AD9502,  to  appropriate  horizontal  and  vertical 
blanking  signals  and  other  video  timing  signals, 
which  are  needed  later  to  convert  back  to  analog 
video.  Although  a  final  configuration  would,  use 
the  signal  directly  from  the  focal-plane  array 
and  not  RS-170,  we  used  RS-170  because  of  its 
compatibility  with  many  prototype  IR  arrays 
and  standard  video  equipment. 

5.2.  Display 

After  processing  the  digitized  image, 
reconversion  to  an  analog  video  signal  is 
necessary  to  display  the  image.  This 
reconversion  is  accomplished  using  the  AD9701 
digital-to-analog  (D/A)  converter  This 
component  will  construct  a  video  signal  from  the 
8-bit  digital  pixel  information  and  video  timing 
signals.  Equalization  pulses,,  which  are  not 
needed  to  display  the  image,  are  not  added  to 
the  sync  signal;  these  pulses  can  easily  be  added 
with  additional  logic.  We  used  a  16R4 
programmable  logic  device  (PLD)  to  implement 
latch-and-mverter  functions  for  the  simple 
pipeline,  and  used  several  22V10  PLDs  and 
counteis  for  the  distributed  design  to  generate 
the  video  timing  signals. 

5.3.  Bit  Slicing 

A  crude  but  sometimes  useful  technique  for 
improving  contrast  is  bit  slicing.  The  bit-slicing 
function  is  so  simple  that  no  active  devices  are 
required  to  implement  it.  Everything  is  done 
with  one  eight-position  switch.  The  switch 
selects  the  bit  to  be  'sliced;'  that  bit  is  connected 
to  all  the  bits  of  the  output.  As  an  example, 
suppose  an  input  pixel  has  a  grey  level  of  123 
and  we  are  slicing  the  4th  bit  (Fig.  4).  123  has  a 
binary  value  of  01111011.  Because  the  fourth 
bit  is  a  1,.  all  the  output  bits  will  be  Is.  The 


output  pixel  would  have  a  grey  level  of 
11111111  or  255,  which  is  a  white  pixel. 

5.4.  Windowing 

The  resolution  of  the  IR  arrays  wc  used  is  less 
than  the  resolution  we  digitize  to,  resulting  in  an 
image  that  does  not  fill  the  entire  video  frame. 
Also,  symbology  was  added  to  some  imagery 
that  interferes  with  statistics  and  histograms.  A 
windowing  capability  is  needed  to  exclude 
portions  of  the  image  we  are  not  interested  in 
(i.e.,  outside  the  sensors  image  or  symbology),  as 
shown  in  Fig.  5. 

Windowing  is  performed  by  creating  signals 
similar  to  the  video  blanking  signals  by  counting 
horizontally  and  vertically  to  the  desired 
dimensions  of  the  window  To  simplify  changes 
in  window  dimensions  and  to  minimize  the 
number  of  components  used,  we  used  two 
reprogrammable  PLDs. 

5.5.  Contrast  Enhancement 

Contrast  is  one  of  the  most  important  factors 
when  presenting  imagery  to  a  human  observer. 
Much  of  the  IR  imagery  we  collected  suffers 
from  a  lack  of  contrast.  One  simple  improvement 
technique  is  to  stretch  the  contrast  so  that  the 
full  range  of  grey  scales  from  black  to  white  are 
used.  The  implementation  used  compares  each 
pixel  value  in  the  image  to  find  the  maximum 
and  minimum  grey  levels;  then,  uses  an  INTEL 
8751  microcontroller  to  compute  a  mapping 
function  or  look-up  table  (LUT)  to  transform 
each  grey  level  to  one  that  uses  the  entire 
available  range  of  grey  shades  The  LUT  is 
performed  using  a  dual-port  static  RAM  that 
allows  us  to  fill  the  RAM  with  the  LUT  values  on 
one  port,  and  asynchronously  to  use  each 
incoming  pixel  grey-shade  value  to  address  (look 
up)  a  grey-shade  value  for  the  output  pixel  on 
the  other  port  (Fig  6). 
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Fig  4  Bit  slicing. 
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Fig  5.  Windowing 
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Fig,  6.  Contrast  enhancement  scheme. 


5.6.  Histogram  Equalization 

A  second  approach  to  the  contrast  problem  is  to 
modify  the  distribution  of  grey  levels  to  spread 
out  certain  areas  and  compress  others.  One 
commonly  used  technique  is  histogram 
equalization  The  histogram  (grey-level 
distribution)  of  the  image  is  computed  and  used 
to  create  a  mapping  function,  or  LUT,  that  will 
spread  the  grey-level  distribution  equally  over 
all  the  available  grey  levels — thus,  histogram 
equalization.  Truly  equal  distribution  is 
impossible  because  of  the  limits  of  finite 
arithmetic,  but  the  results  can  significantly 
enhance  contrast  in  an  image. 

Histogram  equalization  is  a  complicated 
technique  to  implement.  The  histogram  is 
computed  using  an  accumulator  RAM  that  uses 
the  incoming  pixel  grey-level  values  for 
addressing,  and  increments  each  location  every 
time  the  location  is  addressed  (Fig.  7).  The 
accumulated  histogram  is  computed  by  starting 
at  grey  level  0  (black)  and  adding  up  or 
accumulating  all  the  previous  histogram  values 
for  each  grey  level  (Fig.  8).  The  accumulated 
histogram  is  converted  to  a  histogram 
equalization  transfer  function  or  LUT  by 
rounding  off  the  16  bit  or  216  range  of  the 
accumulated  histogram  to  an  8  bit  or  256  range 
(Fig.  9). 

We  used  an  LSI  Logic  L64250  Histogram  Hough 
Processor  (HHP)  chip  to  perform  histogram 
equalization.  This  device  contains  the  needed 
accumulator  RAM  and  LUTs.  We  used  a 
programmable  sequencer,  Advanced  Micro 
Devices  (AMD)  PMS14R21(  to  initialize  the  HHP 
chip  using  a  state  machine  design. 

5.7.  Frame  Averaging 

A  very  effective  noise-reduction  technique  is 
frame  averaging,  The  current  input  image  is 
added  (averaged)  with  a  past  image,  which  is 
stored  in  memory,  to  form  an  output  image  The 
output  image  becomes  the  image  stored  m 
memory  for  the  next  image.  To  keep  the  memory 


from  overflowing  because  of  accumulation,,  a 
division  of  the  pixel  value  by  two  is  necessary. 
The  simplest  way  to  divide  the  pixel  by  two  is  to 
drop  the  least  significant  bit  (LSB)  of  the  9-bit 
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sum.  Large  static  RAMs  are  needed  to  store  the 
image;  two  image  memories  are  used  (Fig.  10) 
because  of  the  need  to  read  and  write  for  each 
pixel 

5.8.  Median  Filter 

A  useful  technique  in  removing  noise  is  median 
filtering.  A  small  group  of  pixels  is  sorted  by 
value  and  the  middle  value  chosen  to  replace  the 
center  pixel.  This  process  eliminates  high 
frequency  noise  in  an  image  and  is  often 
superior  to  averaging  techniques.  A  nonlinear 
filter  was  implemented  using  an  LSI  Logic  64220 
rank  value  filler  (RVF'.  The  RVF  performs  all  the 
comparisons  necessary  to  sort  pixels  in  a 
configurable  64-pixel  window  at  speeds  up  to  20 
MHz.  A  simple  l-by-5  window  was  chosen  for 
this  application  and  the  median  value  chosen, 
although  minimum  or  maximum  filters  also  can 
be  implemented.  A  simple  state  machine  design 
implemented  with  standard  22VI0  PLDs  is 
necessary  to  initialize  the  RVF  chip 

5.9.,  Target  Detection 

A  representative  target  detection  technique 
using  statistics  obtained  from  a  co-occurrence 
matrix  was  selected  and  implemented  in  one  of 
our  modules.  The  co-occurrence  matrix  is  the 
joint  grey-level  distribution  of  an  image  (Ref  4). 
Basically,,  each  pixel  is  compared  to  its  neighbor 
and  a  special  histogram  is  made  Co-occurrences 
of  grey  levels  (identical  neighbors)  represent 
homogeneous  regions  in  an  image.  Assuming  that 
man-made  targets  in  an  IR  scene,  such  as  ships, 
are  more  uniform  in  grey  shade  than  the 
background,  the  co-occurrence  matrix  provides  a 
method  to  detect  these  targets  In  simple  scenes, 
the  largest  object  is  defined  as  the  background, 
and  the  second  largest  as  the  target  or  targets. 
The  co-occurrence  histogram  is  divided  into  two 
parts  to  segment  the  target(s) 

To  implement  this  algorithm,  only  a  portion  of 
the  co-occurrence  matrix  needs  to  be  computed. 
The  co-occurrences  of  the  same  grey  levels  and 
those  that  differ  by  two  were  chosen  based  on 
empirical  data.  For  each  pixel,  a  comparison  is 


made  between  that  pixel  and  the  previous  pixel. 
If  the  pixels  are  equal,  or  differ  by  only  two  grey 
levels,  that  pixel  value  is  added  to  a  histogram 
computed  by  two  LSI  Logic  L64250  HHP  chips 
(as  described  in  section  5.7).  Two  chips  are 
needed  because  a  16-bit  histogram  will  be  read 
out.  The  histogram  of  co-occurrences  is  read  out 
by  an  AT&T  DSP16A  digital  signal  processor 
(DSP)  chip  and  the  histogram  segmented  into 
target  and  background.  A  threshold  for 
segmentation  of  the  image  is  calculated  and  the 
image  is  processed  accordingly  to  highlight 
potential  targets.  While  co-occurrence  histogram 
data  take  one  frame  to  accumulate  and 
additional  time  to  process,  the  threshold  is  used 
on  the  current  pixel  data  even  though  the 
threshold  is  based  on  statistics  from  the  previous 
frame.  This  technique  avoids  costly  frame 
buffers  and  the  associated  delays.  Scene 
statistics  do  not  change  significantly  from  one 
frame  to  the  next. 

6.  RESULTS 

All  boards  functioned  as  anticipated.  Video  data 
at  real-time  rales  (30  frames/second)  were  fed 
into  the  boards,  and  the  output  of  the  boards 
was  real-time  enhanced  imagery.  A  major 
advantage  of  this  system  is  the  flexibility 
provided  by  having  each  function  on  a  separate 
board  or  module.  This  modularity  allows  many 
configurations  and  combinations  of  algorithms  to 
be  tested  on  a  variety  of  imagery.  The 
architecture  is  such  that  other  functions — 
tracking  or  target  identification— can  be  added  to 
the  filters  and  target  detection  modules.  If  this 
design  were  chosen  for  future  imaging  weapons 
systems,  significant  savings  could  be  realized  in 
later  modifications  and  other  configurations.  This 
modular  processor  can  now  be  considered  an  off- 
the-shelf  design  available  and  adaptable  to 
many  applications. 
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Fig  10  Frame  average  diagram 


8.  REFERENCES 

1.  McCauley,,  H.,  "Image  Enhancement  of 
Uncooled  Focal  Plane  Array  Imagery," 
Infrared  Systems  and  Components  III,  SPIE, 
Vol.  1050,  1989. 

2.  Auborn,  J.  E.,  Fuller,  J.  M.,  and  McCauley,  H., 
"Target  Detection  Using  Co  Occurrence  Matrix 
Segmentation  and  Its  Hardware  Imple¬ 


mentation,"  Optical  Engineering  and  Photonics 
in  Aerospace  Sensing ,  SPIE,  Vol.  1482,  1991. 

3  Pratt,  W.  K.,  Digital  Image  Processing,  New 
York,  John  Wiley  &  Sons,  Inc.,  1978,  pp.  154- 
155. 

4.  Rounds,  E.  and  Sutty,  G.,  "Segmentation  Based 
on  Second  Order  Statistics,"  Image  Under¬ 
standing  Systems  II,  SPIE,  Vol.  205,,  1979. 


DI6CP88IOM 

DISCUSSOR  :  Mr  T.  FERRE  (France) 

(NU)  ..  IS  your  Signal  Processor  capable  of 
processing  other  data  than  RS.170  ? 


(NU) .  Ves,  the  processor  design  and  most 
of  the  modules  can  handle  other  video 
formats  at  speeds  up  to  20  MHz.  The 
digitizer  and  display  modules  would  need 
to  be  changed  to  handle  PAL,  SECAM  or 
other  military  formats,  but  the  rest  of 
the  modules  and  the  system  architecture 
can  remain  the  same. 
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Image  Enhancement  of  Infrared  Uncooled  Focal  Plane  Array  Imagery 
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SUMMARY 

Several  simple,  low-cost  algorithms  have  been 
explored  for  use  in  the  enhancement  of  imagery 
produced  by  uncooled  focal  plane  arrays  (UFPA). 
These  algorithms  address  the  main  problems  that 
UFPA-produced  imagery  typically  demonstrate  In 
addition  to  enhancing  UFPA-produced  imagery,  all 
these  algorithms  are  simple  and  allow  for  inexpensive 
hardware  implementation. 

1.  INTRODUCTION 

The  number  of  applications  requiring  low-cost  infrared 
imagers  has  increased.  Many  of  these  applications  use, 
or  plan  to  use,  infrared  uncooled  focal  plane  arrays 
(IRUFPA)  to  meet  these  imaging  requirements  Many 
advantages  to  using  IRUFPAs  exist  (such  as  low  cost, 
no  required  cooling,  and  no  complex  mechanical¬ 
scanning  devices),  but  one  disadvantage  has  always 
been  the  quality  of  IRUFPA-produced  imagery 
IRUFPA  imagery  commonly  suffers  from  a  lack  of 
image  contrast  and  resolution. 

Classical  image-processing  and  enhancement 
techniques  (Ref.  1-4)  can  be  used  to  improve  the 
quality  of  IRUFPA-produced  imagery.  In  addition, 
these  techniques  can  be  kept  simple  enough  to  run  the 
algorithms  in  real  time  without  expensive  hardware 
implementations  and  still  achieve  large  quality 
improvements 

2.  UFPA-PRODUCED  IMAGERY 

Uncooled  focal  plane  arrays  are  an  inexpensive  and 
highly  reliable  alternative  to  expensive  infrared- 
imaging  systems.  Uncooled  focal  plane  arrays  operate 
at  room  temperature,  eliminate  expensive  cryogenic- 
cooling  systems,  and  eliminate  expensive  and  complex 
scanning  devices.  Expense  is  not  the  only  benefit  of  the 
uncouled  infrared-imaging  devices.  Reliability  also  is 
improved  because  the  cryogenic-cooling  systems  and 
the  complex  scanning  devices  are  often  sources  of 
problems  for  infrared  imagers. 

The  UFPA  imagers  are  attractive  because  they  are 
highly  reliable,  low-cost  devices,  but  the  raw  images 
they  produce  often  is  not  good  enough  for  many 
applications.  After  looking  at  and  analyzing  a  number 
of  UFPA-produced  images,  we  found  several  problems 
One  problem  is  low  resolution,  which  is  caused  by 
manu  facturing  large  dense  arrays.  Although  some 
techniques  exist  to  improve  low-resolution  devices,  we 
opted  not  to  explore  this  avenue  of  enhancement. 

The  imagery  made  by  a  low-sensitivity  imager  often 
displays  a  low-contrast  differential  between  objects  in 
the  imagery  and  the  background  Many  techniques  for 
contrast  enhancement  were  explored  and  are  described 
in  the  next  section. 

The  last  imagery-display  problem  that  we  looked  at  is 
a  low  signal-to-noise  ratio.  In  other  words,  the  imagei  y 
is  very  noisy.  There  are  two  types  of  noise  that  plague 
the  UFPA-produced  imagery.  The  first  is  random  ncise 


and  the  second  is  fixed-pattern  noise.  We  effectively 
eliminated  random  noise  from  UFPA-produced 
imagery  and  will  describe  this  process  in  the  next 
section  Fixed-pattern  noise,  on  the  other  hand,  is  more 
difficult  to  eliminate. 

3.  UFPA  IMAGE  ENHANCEMENT 
Numerous  algorithms  are  available  to  perform 
contrast  improvement  or  noise  reduction.  We  wanted 
to  produce  the  best  imagery  possible,  but  more 
importantly,  we  wanted  to  select  algorithms  that  were 
simple,  inexpensive  to  implement  in  real-time 
hardware,  and  effective.  This  selection  allows  us  to 
combine  an  imager/image-processing  hardware  into 
one  small  package  and  still  keep  the  cost  beiow  that  of 
other  infrared  systems. 

3.1.  Contrast  Improvement 

Most  of  the  algorithms  available  for  contrast 
improvement  are  simple  and  easy  to  implement  at  low 
cost  in  real-time  hardware,  but  we  wanted  an 
algorithm  that  brought  out  the  most  detail  in  UFPA 
imagery  (Fig.  1).  Some  of  the  algorithms,  which 
improved  the  contrast,  reduced  the  amount  of  detail  a 
viewer  could  distinguish.  Three  of  the  algorithms  we 
ooked  at  are  discussed  below. 


*  V‘  '  • 

Figure  1  Original  UFPA-produced  image 


311  Bit  slicing 

Images  are  stored  in  a  computer  as  arrays  of  discrete 
samples  called  pixels  (Fig.  2).  Each  pixel  is  represented 
as  an  n-bit  value.  The  image  array  also  can  be 
described  as  being  an  array  of  bits  that  is  n-planes  deep 
(Fig.  3).  An  example  would  be  an  image  of  512  by  512 
pixels  in  size.  Each  pixel  is  digitized  to  8  bits  (a  total  of 
256  different  gray  shades  can  be  represented  by  each 
pixel).  We  could  also  imagine  this  image  as  being  512 
by  512  bits  in  size  by  8  planes  deep.  Bit  slicing  is  a 
simple  and  effective  method  of  contrast  enhancement. 
If  we  choose  one  plane  and  pull  it  out  of  the  image, 
much  like  pulling  a  card  from  a  deck,  and  display  it  as 
a  binary  image  (a  0  bit  displays  black,  a  1  bit  displays 
white),  we  improve  the  contrast  of  the  image.  The  trick 
is  to  choose  the  correct  plane. 

Not  all  information  is  represented  in  each  of  the  bit 
planes.  For  instance,  the  least  significant  bit  plane  will 
look  like  white  noise  because  only  small  changes  in 
gray  shade  ar.oss  the  image  usually  are  represented. 
Larger  changes  in  gray  shade  will  be  represented  in 


i.v: 


the  more  significant  bit  planes  until  the  most 
significant  planes  are  reached  These  planes  often  are 
seen  as  all  black  or  all  white.  It  is  important  to  choose 
the  plane  that  contains  the  information  you  most  want 
to  see  (Fig  4) 

Bit  slicing  is  an  effective,  inexpensive,  and  simple 
method  of  contrast  enhancement,  but  eliminates  too 
much  of  the  image  detail  and  was  not  selected  in  the 
final  analysis. 


Figure  3  Image  stored  in  planar  format 


312  Histogram  equalization 

Histogram  equalization  is  more  complex  than  bit 
slicing.  However,  the  algorithm  is  more  effective  at 
enhancing  the  contrast  of  an  image  because  more  of 
the  image’s  detail  is  preserved.  The  first  operation  is  to 
compute  the  image  histogram;  that  is,  plot  the  gray 
level  probability-density  function  on  a  two- 
dimensional  graph  with  X  representing  the  gray  scale 
and  Y  representing  the  number  of  pixels  of  a  specific 
gray  shade  in  the  image.  Fig.  5  is  a  typical  histogram 
of  a  low-contrast  image;  note  that  the  gray  values  are 
grouped  toward  one  side  of  the  grav  scale.  To  equalize 
the  histogram,  a  look-up  table  (Fig  6)  is  computed  so 
that  the  gray  area  is  stretched  from  its  typical  bell¬ 
shaped  curve  into  a  more  lineai  format  (Fig.  7).  This 
technique  spreads  the  gray  area  over  the  entire  range 
of  gray  shades  available  to  the  display,  and  results  in 
an  image  of  much  higher  contrast.  Temperature 
variations  within  the  image  show  up  and  the  image 
content  is  more  distinct  (Fig.  8). 
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Figure  5  Histogram  of  low-contrast  image 


Figure  6  Look-up  table  used  to  flatten 
image  histogram 


Figure  4  Selected  one-bit  plane  displayed 

as  binary  image  Figure  7  Flattened  histogram 


13-3 


Figure  8  Image  after  histogram  equalization 


The  histogram-equalization  algorithm  is  a  fast  and 
effective  contrast-improvement  algorithm.  However, 
the  algorithm  described  below  proved  to  be  more 
effective  in  preserving  image  content. 

3  1.3.  Contrast  enhancement 

Contrast  enhancement  is  a  technique  similar  to 
histogram  equalization.  However,  the  bell  shape  of  the 
original  histogram's  curve  is  preserved,  A  look-up 
table  (Fig.  9)  also  is  used  to  distribute  gray  shades 
more  evenly  over  the  entire  range  of  the  display  to 
enhance  image  contrast  (Fig.  10). 

Contrast  enhancement  proved  to  be  the  best  of  the 
algorithms  we  tried.  We  implemented  the  algorithm  on 
an  image  processor,  analyzed  the  results  in  non-real 
time,  ported  our  algorithms  to  a  real-time  system  built 
from  off-the-shelf  components,  and  analyzed  the 
results.  Currently,  we  are  working  on  some  special- 
purpose  hardware  using  VHSIC  and  ASIC 
technologies  to  perform  the  algorithm  in  real  time. 


techniques,  will  reduce  the  noise  in  an  image;  all  are 
well  documented  and  many  work  very  well  We  had 
great  success  with  the  Fourier  analysis  and  the  image- 
integration  techniques.  The  low-pass  filters  blurred 
the  image  and  eliminated  too  much  of  the  detail  that 
we  wanted  to  keep.  Median  Inters  were  not  effective 
because  of  the  low  resolution  of  the  image-required 
pixel  replication  that  expands  the  image. 

3  21.  Fourier  analysis 

Fourier  analysis  proved  to  be  an  effective  method  of 
filtering  the  noise  from  the  image  The  two- 
dimensional  Fourier  trans.orm  of  the  original  image 
was  computed  giving  an  image  of  the  frequency 
domain.  A  band-pass  filter,  which  filtered  out  the  high- 
frequency  noise,  was  applied  to  the  two-dimensional 
fast-Fourier  transform  (FFT).  Then  the  inverse 
Fourier  transform  was  applied  to  the  filtered 
frequency-domain  image  and  the  filtered  image  was 
the  resultlFig.  11). 


(a)  FFT  of  image 
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Figure  9  Look-up  table  used  during 
constrast  enhancement 


Figure  10  Image  after  contrast  enhancement 


3.2.  Noise  Reduction 

Many  available  algorithms,  such  as  low-pass  filters, 
median  filters,  Fourier  filters,  and  integration 


(b)  FFT  after  band -pass  filter  opertion 


(c)  Image  after  Fourier  analysis  and 
contrast  enhancement 

Figure  1 1  FFT,  filtered  FFT,  and  resultant  image 
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Fourier  analysis  is  a  good  algorithm  to  use  in  filtering 
UFPA  imagery.  However,  we  wanted  an  algorithm 
that  would  preserve  more  of  the  image  edge  and  detail 
information.  Image  integration  filled  this  request, 

3.2  2  Image  integration 

The  technique  of  image  integration  (Fig.  12)  is  used  to 
eliminate  (average  out)  random  or  white  noise 
typically  seen  in  UFPA-produced  imagery.  During  this 
process  new  video  frames  are  added  to  the  contents  of 
the  image  memory,  which  contains  the  running 
average  of  the  video  memory.  The  sum  of  the  n  .w  video 
frame  and  the  averaged  images  is  divided  by  two  and 
displayed  as  the  corrected  image.  At  the  same  time,  the 
result  is  reloaded  into  image  memory  to  await  the 
addition  of  the  next  new  video  frame.  For  better 
results,  the  running  average  of  more  than  two  images 
can  be  displayed  (Fig.  13). 


an  off-the-shelf  real-time  system,  and  are  working  on 
special-purpose  hardware  to  perform  the  algorithm. 

3.3.  Combinations 

We  identified  two  algorithms  that  address  separate 
problems  with  UFPA-produced  imagery,  and  wanted 
to  see  how  they  performed  together.  Could  they  be  put 
together  and  retain  their  simplicity  and  effectiveness? 
We  discovered  that  the  combination  of  image 
integration  followed  by  contrast  enhancement  works 
extremely  well  (Big.  14). 


Figure  12  Flow  diagram  of  image-integration 
alnjrithm 


Figure  14  Image  after  image  integration  and  contrast 
enhancement 


4.  CONCLUSIONS 

Our  t»sts  with  the  image  processor  and  our  real-time 
system  proved  that  UFPA-produced  imagery  can  be 
improved  significantly  by  using  simple,  easy  to 
implement,  fast  image-processing  algorithms  like  the 
combination  image-integration/contrast-enhanccment 
algorithm.  We  are  continuing  exploration  of  different 
image-processing  techniques  to  find  more  effective  yet 
simple  solutions  to  the  UFPA-imagery  problem. 


Figure  13  Image  after  image  integration 


Image  integration  has  faults.  First,  if  the  imager  is 
moving,  the  resulting  image  tends  to  blur,  which  is 
more  apparent  when  the  number  of  frames  is 
increased.  Secondly,  the  image  integration  technique 
does  not  remove  the  fixed-pattern  noise  seen  in  UFPA 
imagery.  In  fact,  image  integration  tends  to  enhance 
fixed-pattern  noise  The  benefits  of  the  algorithm  seen 
greater  than  the  drawbacks.  We  are  analyzing  the 
algorithm  using  a  non-real-time  image  processor  and 
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DISCUSSORi  Hr  J.  DAN6AC  (France) 

(NU). 

1)  What  as  the  type  of  Focal  Plane 
Array  ? 

2)  What  is  the  application  ? 

APTBQB'S  REPLY  ! 

(NU)  , 

1)  Ferroelectric  Focal  Plane  Array 
(FPA) 

2)  Possible  applications  : 

-  Rifle  sights 

-  Seekers  /  Missile  guidance. 
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Target  Cuing — A  Heterogeneous  Neural  Network  Approach 


Howard  McCauley 
Attack  Weapons  Department 
Naval  Weapons  Center 
China  Lake,  California  93555-6001 


SUMMARY 

Autonomous  analysis  of  complex  image  data  is  a 
critical  technology  in  today's  world  of  expanding 
automation.  The  growth  of  this  critical  iield  is  slowed 
by  problems  in  traditional  image  analysis  methods. 
Traditional  methods  lack  the  speed,  generality,  and 
robustness  that  many  modern  image  analysis 
problems  require.  While  neural  networks  promise  to 
improve  traditional  techniques,  homogeneous  neural 
network  systems  have  difficulty  performing  all  the 
diverse  analysis  required  of  an  autonomous  system. 
This  paper  proposes  a  dual-staged,  heterogeneous 
neural  network  approach  to  image  analysis; 
specifically,  a  way  to  solve  the  target  cuing  problem. 

1.  INTRODUCTION 

The  target  cuing  problem  can  be  separated  into  two 
distinct  operations;  feature  extr'ction  and  feature 
classification.  Experimentation  has  shown  that 
biologically  inspired  neural  networks  perform  feature 
extraction  from  raw  imagery  extremely  well,  but  are 
not  as  good  at  classifying  those  features  once 
extracted.  Back-propagation  networks  can  be  taught 
to  reliably  classify  image  features  once  the  features 
have  been  extracted  from  the  original  image. 
However,  teaching  these  back-propagation  networks 
to  extract  features  from  a  raw  image  on  their  own  is 
very  difficult. 

We  propose  a  dual-staged,  heterogeneous  neural 
network  approach  to  autonomous  target  cuing.  Stage 
1  of  the  target  cuing  algorithm  uses  biologically 
inspired  neural  networks  to  extract  features  from  raw 
imagery. 

Stage  2,  a  back-propagation  neural  network,  accepts 
those  image  features  and  performs  the  final 
classification.  The  result  is  a  determination  as  to 
whether  a  target  exists  in  a  specific  portion  of  the 
image,  based  on  the  features  extracted  by  the 
biologically  inspired  networks  .  Fig  1  illustrates  this 
approach. 


2.  FEATURE  EXTRACTION  STAGE- 
BIOLOGICALLY  INSPIRED 
NEURAL NETWORKS 

2.1.  Definition 

The  feature  extraction  stage  is  implemented  using  any 
number  of  small  biologically  inspired  networks,  one 
for  each  feature  you  wish  to  extract.  The  definition  of 
a  biologically  inspired  neural  network,  for  the  purpose 
of  this  paper,  is  a  network  that  extracts  any  low-level 
feature.  The  term  biologically  inspired  is  based  on 
work  that  seems  to  demonstrate  that  biological  vision 
systems  perform  similar  feature  extraction  operations 
(Ref.  1).  None  of  the  networks  discussed  in  this  paper 
are  morphologically  similar  to  biological  systems. 
Examples  of  networks  used  to  perform  this  type  of 
low-level  feature  extraction  include  Hopfleld,  forward- 
propagation,  and  back-propagation  networks. 

2.2.  Features  To  Be  Extracted 

Many  low-level  features  exist  that  can  be  used  to 
represent,  segment,  and  explain  raw  input  imagery. 
Several  low-level  features  clearly  have  more  influence 
in  the  image  understanding  process  and  were  selected 
as  features  we  wanted  to  use  in  our  target  cuing 
system.  These  features  include  directional  edge 
features,  endpoint  features,  corner  features,  low-level 
regional  statistics,  regional  textural  statistics,  and 
motion. 

Directional  edge  and  endpoint  features  were  extract/  d 
using  a  combination  of  forward-propagation  networks 
arranged  in  a  two-layer  configuration.  Layer  1  (Fig.  2) 
is  constructed  of  forward-propagation  networks  and  is 
used  to  extract  the  edge  gradient  information 


In  the  Layer  1  forward-propagation  network,  specified 
inputs  are  taken  from  the  raw  image  in  parallel. 


Then,  these  inputs  are  multiplied  by  weights 
associated  with  each  line  and  summed.  The  result  of 
the  summation  is  put  through  a  nonlinear  trans¬ 
formation.  The  function  of  the  forward-propagation 
network  is  determined  by  the  inter-connections,  the 
weights  set  on  each  interconnect,  and  the  output 
transformation. 

The  Layer  1  interconnection  matrix  is  set  using  a 
Laplacian  of  Gaussian  operator.1  The  equation  for  the 
Laplacian  of  Gaussian  operator  is 


where  o  is  the  standard  deviation  of  the  Gaussian  and 
r  is  the  radius.  The  reason  for  using  the  Laplacian  of  a 
Gaussian  is  that  edges  in  all  orientations  are  extracted 
in  a  single  step  as  compared  to  directional  edge 
detection  techniques  like  the  Sobel  edge  operator.  The 
Laplacian  of  Gaussian  operator  is  shown  m  Fig.  3. 

The  edge  information  computed  in  Layer  1  is  put 
through  Layer  2,  which  is  composed  of  20  directionally 
tuned  forward-propagation  networks  in  parallel.  Each 
network  in  Layer  2  acts  like  a  filter,  eliminating  all 
edge  segments  not  oriented  in  the  tuned  direction. 

The  weight  matrices  for  each  of  the  directionally  tuned 
networks  are  computed  using  the  back-propagation 
algorithm.  Edges  in  all  orientations  are  used  as  input 
to  an  untrained  network.  Edges  of  various  contrast, 
noise,  and  slope  are  also  used  to  train  the  directional 


(a)  Three-dimensional  representation 


networks.  After  the  network  weights  have  been 
trained,  the  weights  are  saved  and  then  used  in  the 
model.  Ref.  2  contains  additional  information  on  the 
backpropagation  algorithm  used  for  setting  the 
directional  edge  filter  weights.  Desired  responses  for 
each  of  the  inputs  are  developed  for  each  oriented 
network. 

Figure  4  represents  the  entire  two-layer  process. 

Corner  features  are  extracted  using  a  forward- 
pr  pagation  network  with  sigma  pi  connections  (Fig. 
5).  The  endpoint  features  extracted  in  Layer  3  are 
input  to  the  corner  feature  network.  Fig.  6  shows  this 
process. 

At  this  time,  low-level  regional  statistics,  regional 
textural  statistics,  and  motion  have  not  been 
integrated  into  the  model;  therefore,  they  will  not  be 
discussed  further. 
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Fig  4  Low-level  feature  extraction  network 


Fig  5  Sigma  pi  network 


Fig  6  Endpoint  interconnects  within  the 
sigma  pi  network 


3.  BACK  PROPAGATION — MADAi.INE  111 
After  Stage  1  has  extracted  the  low-level  image 
features,  Stage  2  analyses  the  features  to  determine  if 
(b)  Two-dimensional  representation  a  target  is  present  in  the  field  of  view.  The  analysis  is 

performed  using  a  number  of  back-propagation  neural 
networks  trained  with  the  MADALINE  III  or  back- 
Fig  3  Laplacian  of  Gaussian  kernel  propagation  learning  rules. 
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o.i.  Arcnueciure 

The  Stage  2  architecture  (Ref.  3)  breaks  the  image 
feature  space  into  a  number  of  small,  medium  and 
large  overlappmg  circular  regions  and  assigns  an 
identical  (in  terms  of  weight  and  architecture)  back- 
propagation  network  to  each  of  the  circular  regions 
hi?"  U .  Feature.  sPace, «»  a  two-dimensional  object 
1  -.TtainS  ,exU?ct?d  lmage  Matures,  which  are 
spatially  correlated  with  the  image  from  which  they 
were  extracted.  One  back-propagation  network  is 
responsible  for  analyzing  only  those  features  extracted 
from  its  assigned  region.  Enough  small  region/back- 
propagation  network  combinations  exist  to  cover  the 
entire  image.  Also,  enough  medium  and  large 
combinations  exist  to  fully  cover  the  entire  image 
This  arrangement  of  various  sized  segments  gives  the 
model  its  scale  and  translational  invariance.  Various 
scales  can  be  achieved  by  changing  the  number  and 
size  of  the  regions. 


fig  7  Segmentation  of  image  feature  space 
into  a  small,  medium,  and  laigearea 

Each  circular  region  and  its  associated  back- 
propagation  network  is  termed  a  column.  Each 
column  is  broken  into  four  layers  I.ayer  1  is  a 
forward-propagation  network  used  to  collect  the  low- 
level  features  computed  in  Stage  1  and  feed  the 
features  to  Layers  2  through  4.  Layers  2  through  4  are 

MADAknPNPPmat,0K  !!£twork  trained  w'th  the 
MADAL1NE  UI  or  back-propagation  learning  rule 

Layers  2  through  4  are  responsible  for  analyzing  the 
features  and  determining  whether  the  features 
indicate  target  or  background. 

Layer  1  of  Stage  2  is  segmented  into  19  circular 
subregions  (Ref  3),  each  separated  by  the  radius  r,  Fig 
8  shows  the  placement  of  each  of  these  19  subregions  8 

Each  of  these  19  subregions  contains  one  neuron  per 
feature  extracted  in  Stage  1  All  neurons  are  located  at 


•  •  • 

fig  8  Placement  of  19  subregions 
within  a  column 


the  center  of  them  circular  subregion.  The  response  of 
each  neuron  indicates  whether  that  feature  exists 
within  the  subregions  field  of  view;  and  if  the  feature 
exists,  how  far  the  feature  occurs  from  the  center  of  the 

response's  ^  eqUati°D  *  compute  0,6  neuron 

R  =  1  —  (d/r)0.5 

where  R  equals  the  response,  d  equals  the  distance 
of  the  subregion  to  the  feature,  and  r 
equals  the  subregional  radius.  Then,  R  is  put  through 

function  before  being  put  into  the  layer  2 
back-propagation  network.  ' 

The  number  of  interconnects  between  Layers  1  and  2 
1  19t  Eumber  of  Matures  extracted  in  Stage 

1.  Layer  2  feeds  into  Layer  3.  which  contains  10 
neurons;  Layer  3  feeds  into  Layer  4,  which  contains  a 
ng  ®nf  uron-  The  Layer  4  neuron  indicates  whether 
or  not  a  target  is  within  the  columns  field  of  view  Fig 
9  shows  Layers  2, 3,  and  4  of  Stage  2.  g' 

TAAOrr*ACK<MK>UMO 


Fig  9  Layers  2, 3,  and  4  of  Stage  2 

Once  the  model  has  been  constructed,  the  back- 
propagation  networks  roust  be  trained.  All  the  back 
propagation  networks  contain  identical  weight  sets  so 
only  one  column  needs  to  be  trained.  Then,  the 
weights  are  copied  to  all  the  remaining  columns 
Representative  background/target  sets  are  displayed 

desir^S8  0,8  W6iehtS  8re  a4iuSted  10  give  016 

Layers  2,  3,  and  4  of  Stage  2  were  decoupled  from  the 

th?hn‘?e  m0de  10  decrease  the  time  used  to  teach 
the  back  propagauon  network.  Representative  data 
were  displayed  to  Stage  1  and  Layer  1  of  Stage  2  and 
the  outputs  stored  in  data  files.  Then,  the  Laver  2 
bark-propagation  networks  were  taught  using  the 

nepr|t?red  featUre  dLta  as  mpUl'  Wh,cb  e)™inatcd  the 
need  to  recompute  the  feature  data  each  time  the  same 

network.  W8S  d‘Splayed  10  the  ^-propagation 
4.  RESULTS 

Several  experiments  were  performed  to  validate 
various  portions  of  the  model  described.  Results  have 
been  obtained  on  binary  character  image  data  as  well 
as  on  poor  quality  imagery  of  a  bridge  Results  of 
wflf  experiments  are  shown  in  Figs.  10  through  12. 
We  have  been  able  to  successfully  recognize  characters 
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in  an  image  of  text.  Initial  results  on  the  poor  quality 
bridge  imagery  are  promising;  however,  more  work 
needs  to  be  done.  The  integration  of  additional 
features  will  be  the  focus  of  much  additional  work. 


-*-*  -  *»«.•«.  V  $  t  *3  % 

,  "*■*»  **r  <  «  #e. 


Fig  10  Raw  bridge  image 


(a)  Raw  image  rotated  0  degrees, 
output  of  vertical,  horizontal,  and  45- 
degree  filters. 


(b)  Raw  image  rotated  45  degrees, 
output  of  vertical,  horizontal,  and  45- 
degree  filters 


Fig.  1 2.  Bridge  image  after  layer  4  of  Stage  2 
Brighter  pixels  in  this  image  indicate  a  higher 
confidence  in  that  pixel  belonging  to  a 
target 


6.  CONCLUbiuNS 

Experimentation  has  shown  that  biologically  inspired 
nt’.iral  networks  extract  features  from  raw  images 
very  well,  yet  perform  poorly  when  required  to  use 
those  same  features  to  classify  the  pixels  as  belonging 
to  a  target  or  to  the  background.  Back-propagation 
networks  are  good  at  solving  the  feature  classification 
problem,  but  perform  poorly  with  the  feature 
extraction  problem.  The  solution  is  to  use  both 
network  architectures:  the  biologically  inspired 
networks  to  perform  the  low-level  lecture  extraction, 
and  the  back-propagation  network  to  perform  the 
classification  of  those  features. 

Computer  simulations  of  this  heterogeneous  neural 
network  are  being  developed  and  tested.  While  initial 
results  indicate  great  promise,  much  work  remains.  Of 
the  remaining  work,  integration  of  additional  features 
is  most  important  and  will  provide  the  greatest 
challenges  and  advances 
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Fig  11.  Experiments  of  layer  4  of  Stage  1,  directional 
and  endpoint  filters 
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1.  SUMMARY 

A  number  of  acquisition,,  tracking,  and 
classification  algorithms  have  been  developed  to 
deal  with  various  image  processing  problems  in 
the  laboratory.  Typically,  these  algorithms  are 
too  complicated  to  implement  in  a  low-cost,  real¬ 
time  processor.  Using  image  data  in  many  real¬ 
time  applications  requires  a  system  with  very 
high  data  rates,  low  power  dissipation,  and  a 
small  packaging  volume.  We  developed  a 
processor  architecture  suitable  for  these 
applications  (Ref  1),,  and  adapted  and 
demonstrated  a  co-occurrence  matrix  target 
detection  algorithm  (Refs  2  and  3)  in  computer 
simulation  and  real-time  hardware. 

A  histogram  or  grey-level  distribution  is  often 
used  to  select  a  threshold  for  image 
segmentation.  This  technique  is  often  inadequate 
as  the  histograms  tend  to  be  noisy  and  exhibit 
many  small  peaks.  Co-occurrence  matrix-based 
segmentation  allows  homogeneous  regions  of  an 
image  to  be  identified  and  separated  from  a 
cluttered  background  Results  are  shown  for 
target  segmentation  using  representative 
infrared  imagery  and  real-time  hardware. 

2.  INTRODUCTION 

Our  goal  was  to  develop  a  method  for  detection 
of  man-made  targets  in  IR  scenes.  The 
application  required  detection  to  be  independent 
of  the  polarity  of  the  image  and  independent  of 
rotation.  The  approach  had  to  be  realizable  in 
real-time  hardware  and  compatible  with  sue 
and  weight  restraints.  We  made  a  laboratory 
demonstration  of  the  detection  algorithm  using  a 
general-purpose  image  processor.  The  resultant 
demonstration  showed  the  capability  of 
detecting  targets.  Real  imagery  was  used  and  the 
results  were  promising.  We  made  an 
architectural  design  to  implement  the  algorithm 
in  hardware,  simulated  the  feasibility  of  the 
approach,  and  made  a  detailed  hardware  design 
A  prototype  system  has  been  fabricated  and 
tested. 

3.  CO-OCCURRENCE  MATRIX 
3.1  Scene  Description 

The  co-occurrence-based  target  detection 
technique  uses  statistics  obtained  of  the 


homogeneous  regions  in  an  image  Man-made 
objects,  such  as  ships,  are  usually  uniform  in 
grey  shade.  However,  the  backgrc  ind  is  full  of 
brush,  trees,  and  other  objects  that  change  grey 
level  rapidly,  For  ship  images,  the  sea  reflects 
the  sky  at  different  angles,,  which  makes  a 
changing  background  (Fig.  1)  A  co-occurrence 
matrix  provides  a  method  to  detect  the 
homogeneous  regions.  In  simple  scenes,  the 
largest  object  is  defined  as  the  background,  and 
the  second  largest  as  the  target  or  targets. 
Because  the  target  differs  in  temperature  from 
the  background  in  most  IR  scenes,  the  target  can 
be  separated  by  using  a  threshold.  Typically,,  a 
threshold  is  found  by  examining  the  grey-level 
distribution  and  calling  the  largest  peak  the 
background,  and  calling  the  second  largest  peak 
the  target.  Often  noise  or  lack  of  contrast  will 
obscure  the  histogram  peak  corresponding  to  the 
target.  The  target  peak  is  still  present,,  just 
obscured.  A  target  separation  threshold  can  be 
found  by  using  a  portion  of  the  co-occurrence 
matrix  to  create  a  histogram  representing 
constant  grey  shade  areas  of  an  image. 


v/ 


Fig.  t  IR  image. 

3.2  Co-Occurrence  Matrix  Definition 
The  co-occurrence  matrix  is  the  joint  grey-level 
distribution  of  pixel  pairs.  PdoO.j)  is  the  relative 
frequency  with  which  :v.  2  pixels  occur  in  the 
image  One  pixel  is  grey  level  i  and  one  is  grey 
level  j  and  they  are  separated  by  distance  d  in 
direction  o.  In  our  case,  the  distance  d  is  always 
one  and  the  direction  o  is  zero  degree  to 
represent  adjacent  pixel  pairs  in  one  line.  Other 
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co-occurrences  can  be  examined,  but  we  only 
used  this  one  for  our  application  to  minimize 
calculations.  A  sample  co-occurrence  matrix  is 
shown  in  Fig.  2. 


Fig  2  Co-occurrence  matrix 

3.3.  Co-Occurrence  Histogram 
To  eliminate  nonhomogeneous  regions  from 
consideration,  we  only  need  to  find  the  portion 
ot  the  matrix  along  the  diagonal.  This  portion 
represents  the  co-occurrences  of  identical  grey 
levels  in  the  adjacent  pixel  pairs  To  allow  for 
some  variations  in  digitization  and  detector 
response,  we  also  included  one  off-center 
diagonal  representing  pixel  pairs  that  differ  by 
two.  For  each  pixel,  a  comparison  is  made 
between  that  pixel  and  the  previous  pixel.  If  the 
pixels  are  equal,  or  differ  by  only  two  grey 
levels,  that  pixel  is  added  to  a  histogram.  The 
sum  of  all  the  diagonals  of  the  co-occurrence 
matrix  provides  a  more  traditional  histogram  or 
grey-level  distribution,  as  shown  in  the  rotated 
co-occurrence  matrix  ot  Figs.  3  and  4.  Fig.  5 
shows  the  histogram  found  from  the  main 
diagonal  of  the  co-occurrence  matrix  and  the 
diagonal  that  represents  pixel  pairs  that  differ 
by  two. 

3.4  Threshold 

Using  the  special  histogram  found  from  co¬ 
occurrences  of  identical  pixel  pairs  and  those 
that  differ  by  2,  a  target  separation  threshold 
can  be  calculated.  The  largest  peak  in  the 


Fig  4  Regular  histogram 


Fig  5.  Co-occurrence  histogram 
(2  diagonals  only) 


histogram  is  assumed  to  belong  to  the 
background  and  the  target  object  tempeiature  is 
assumed  to  be  higher  or  lower  than  the 
background.  A  search  is  made  of  the  histogram 
for  the  second  highest  peak  that  corresponds  to 
the  target  or  tr.-gets.  To  allow  for  noise  in  the 
histogram,  the  second  peak  must  be  a  preset 
number  of  grey  shade  different  from  the 

background  peak.  The  threshold  is  chosen  to  be 
the  value  at  the  local  minimum  between  the 

target  peak  and  the  background  peak  Then  the 
threshold  is  used  to  segment  the  image  into 

candidate  target  areas  (Fig  6).  Some  background 
pixels  also  will  be  on  the  same  side  of  the 
threshold  as  the  target,  so  features,  such  as 
target  size,  shape,  and  orientation,  can  be  used  to 
discriminate  target  from  background.  Time 
integration  of  detections  also  can  be  used  to 
discriminate  false  detections  and  as  the  first 

stage  in  target  tracking. 


Fig  3.  Rotated  co-occurrence  matrix 


Fig  6.  Segmented  image 
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4.  HARDWARE  IMPLEMENTATION 

We  constructed  our  prototype  processor  on 
standard  wire-wrap  cards  for  ease  of 
modifications  and  because  of  time  constraints. 
The  actual  processor  is  shown  m  Fig.  7  Standard 
RS-170  video  is  fed  into  the  processor,  digitized, 
digitally  processed,  and  reconvened  to  an  analog 
video  signal.  The  size  of  the  processor  can  be 
greatly  reduced  in  final  packaging,  but  we  were 
constrained  to  the  size  of  the  wire-wrap  cards 
and  the  desire  to  partition  the  design  by 
functions  into  separate  modules. 


Fig  7.  Processor  hardware 

4.1  Modularity 

The  processor  to  implement  this  design  was 
made  to  take  advantage  of  a  modular  design 
architecture  (Fig.  8).  The  modular  design  allows 
for  future  expansion  of  the  system  or  the  use  of 
the  component  modules  in  other  image 
processing  systems.  The  pixel  information  is 
processed  serially  as  in  standard  video  formats 
in  a  high-speed  pipeline.  No  frame  buffers  or 
other  memories  are  used  to  store  the 
information  in  order  to  avoid  delays  and  reduce 
system  cost,  weight,  and  power  consumption. 
The  design  uses  distributed  power,  and  the  only 
data  shared  between  modules  are  a  common 
master  clock  and  a  reset  signal.  The  8-bit  pixel 
data  are  transferreu  asynchronously  to  a  first-in 
firsl-out  (FIFO)  buffer  on  each  module  using  a 
single  bit  to  mark  the  end  of  lines  and  fields. 

4.2  Digitization 

One  basic  function  necessary  to  process  imagery 
digitally  is  to  digitize  the  image.  The  incoming 


video  signal  (from  1R  imager  or  VCR)  is  digitized 
to  8  bits  and  512  pixels  per  line.  This  resolution 
determines  the  pixel  clock  rate  of  9.8  megahertz 
(MHz).  The  9.8-MHz  pixel  rate  is  doubled  to 
allow  a  faster  system  clock  for  processing.  More 
precision  in  digitization  is  unnecessary  in  most 
applications.  Digitizing  is  performed  by  a  hybrid 
analog-to-digital  (A/D)  converter.  Analog  Devices 
AD9502,  which  will  accept  RS-170  video  directly. 
Programmable  logic  devices  (PLDs)  22V10  are 
used  to  convert  the  video  sync  information, 
supplied  by  the  AD9502,  to  a  special  timing 
signal  used  to  mark  valid  data,  end  of  fields,  and 
other  information.  Although  a  final  configuration 
would  use  the  signal  directly  from  the  focal- 
plane  array  and  not  RS-170,  we  used  RS-170 
because  of  its  compatibility  with  many  prototype 
1R  arrays  and  standard  video  equipment. 

4.3  Filtering 

The  IR  imagery  we  used  suffered  from  high- 
frequency  system  noise,  which  could  easily  be 
removed  by  median  filtering.  A  small  group  of 
pixels  is  sorted  by  value  and  the  middle  value 
chosen  to  replace  the  center  pixel.  This  process 
eliminates  high  frequency  noise  in  an  image  and 
is  often  superior  to  averaging  techniques.  A 
nonlinear  filter  was  implemented  using  an  LSI 
Logic  64220  rank  value  fillet  (RVF).  The  RVF 
performs  all  the  comparisons  necessary  to  sort 
pixels  in  a  configurable  64-pixel  window  at 
speeds  up  to  20  MHz.  A  simple  l-by-5  window 
was  chosen  for  this  application,  and  the  median 
value  chosen,  although  minimum  or  maximum 
filters  also  can  be  implemented.  A  simple  state 
machine  design  implemented  with  standard 
22V10  PLDs  is  necessary  to  initialize  the  RVF 
chip. 

4.4  Co-Occurrenre  Histogram 

The  histogram  ot  matching  pixel  pairs  is 
computed  by  storing  the  current  pixel  in  a  latch 
and  also  storing  that  pixel  with  2  added  to  it.  Our 
circuit  is  shown  in  Fig.  9.  The  stored  values  are 
used  in  the  comparison  of  neighboring  pixels  on 
a  line.  The  function  of  adding  two  and  latching  is 
simple  to  implement  with  some  logic  equations 
and  a  standard  22V 10  PLD.  The  stored  values 
from  the  last  pixel  are  compared  to  the  current 
pixel  If  either  pixel  is  the  same,,  that  pixel's  grey 
level  is  added  to  the  histogram.  CMOS  8-bit 
comparators  were  used  for  the  comparisons  The 
histogram  of  co-occurrences  is  found  using  two 


Video  in 

RS-170,.  Dl9l,izer 
Moduie 


|  Video  out 
Display  JlRS-170 
Module 


Fig  8  Modular  architecture 
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Fig  9.  Hardware  diagram 


LSI  Logic  L64250  Histogram  Hough  Processor 
(HHP)  chips.  The  HHP  chip  is  equipped  with 
accumulator  RAMs  to  compute  a  histogram.  Two 
chips  are  needed  because  the  histogram  values 
will  exceed  the  9-bit  range  of  the  HHP  chips. 

4.5  Threshold  Calculation 

The  histogram  is  read  out  by  an  AT&T  DSP16A 
digital  signal  processor  (DSP)  chip  and 

segmented  into  target  and  background.  A 

threshold  for  segmentation  of  the  image  is 
calculated  and  output  to  a  latch.  While  co¬ 
occurrence  histogram  data  take  one  frame  to 
accumulate  and  additional  time  to  process,  the 

threshold  used  on  the  current  pixel  data  is  based 
on  statistics  from  the  previous  frame.  This 
technique  avoids  costly  frame  buffers  and  the 
associated  delays.  The  fact  that  scene  statistics 
don't  change  significantly  from  one  frame  to  the 
next  can  be  assumed. 

4.6  Segmentation 

The  threshold  stored  in  the  latch  is  used  by  a 
22V10  PLD  and  comparator  to  s<  gment  the 
image.  Each  incoming  pixel  is  compared  to  the 
threshold  and  turned  white  if  the  pixel  is  on  the 
target  side.  The  pixels  on  the  background  side 
can  be  turned  black  or  left  alone,  depending  on 
how  the  imagery  is  to  be  used.  Fig.  9  is  a 
simplified  diagram  of  how  the  co-occurrence 
histogram,;  target  threshold,  and  target 
segmentation  are  implemented  in  our  processor. 

4.7  Reconversion  to  Video 

After  processing  the  digitized  image, - 
reconversion  to  an  analog  video  signal  is 
necessary  to  display  the  image.  This 
reconversion  is  made  using  Analog  Devices 
AD9701  digital-to-analog  (D/A)  converter  This 
component  will  consnuct  a  video  signal  from  the 
8-bit  digital  pixel  information  and  video  timing 
signals.  Seveial  22V10  PLDs  and  counters  were 
used  to  generate  the  necessary  video  timing 
signals 

S.  OTHER  OPTIONS 

The  detected  target  or  targets  in  the  image  can 
be  used  to  cue  an  operator  to  the  target  for 
further  discrimination  or  attention.  The  detected 
object  can  be  tracked  as  it  and  the  sensor  move 
The  target  can  be  identified  or  classified  by 


additional  algorithms.  Target  detection  is  a 
necessary  step  for  these  and  many  other 
functions  commonly  required  in  military, 
scientific,  and  commercial  imaging  systems.  The 
military  applications  include  pilot  or  driver  aids 
and  warnings,  missile  guidance,  and  surveillance. 
Scientific  and  commercial  applications  include 
data  collection,  process  controls,  parts  inspection, 
and  parts  orientation.  Medical  applications 
include  X-ray  analysis,;  tumor  detection,  and 
many  other  uses. 

6.  RESULTS 

Video  data  at  real-time  rates  (30  frames/second) 
were  fed  into  the  boards.  The  output  of  the 
boards  was  imagery  Ath  a  threshold  applied  to 
segment  a  target  While  this  resultant  image 
alone  is  not  very  useful  for  a  human  operator, 
the  image  demonstrates  the  correct  calculation  of 
the  target  grey  level  and  a  threshold  to  segment 
it  from  the  background  A  major  advantage  of 
this  system  is  the  flexibility  provided  by  having 
each  function  on  a  separate  board  or  module. 
This  modularity  allows  many  configurations  and 
combinations  of  algorithms  to  be  tested  on  a 
variety  of  imagery.  The  architecture  allows  other 
functions,  such  as  tracking  or  target 
identification,  to  be  added  to  the  filter  and  target 
detection  inodubs.  Significant  savings  can  be 
realized  in  modifications  a  d  optional 
configurations  This  signal  pM;  ,<■'  and  target 
detection  method  is  now  ready  for  application  lo 
many  systems. 
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1.  INTRODUCTION 


L'lnierp rotation  d'lmages  peul  etre  grandement  factlitie  en 
considirant  simultaniment  des  images  d'une  mime  seine 
produites  par  des  capteurs  de  types  dtffirtnts.  Ainsi,  une 
approche  globale  du  problime  de  fusion  optronique  entrc  deux 
capteurs  IR  et  visible  est  abordie  dans  cet  article,  avec  trois 
mveaux  dissociation  des  donnies 

La  fusion  des  donnies  peut  ainsi  etre  effectuie  au  niveau 
dicisionnel  (classe  d’objets),  it  un  niveau  interm  idiai  re  (objets 
ilimentaires)  et  enfin  au  niveau  du  signal  issu  duectement  des 
capteurs,  A  chaque  itape  de  fusion  sc  pose  le  pronlime  de  la 
mise  en  correspondance  des  donnies  IR  et  visible.  Cette  mise 
en  correspondance  doit  etre  d'autant  plus  pricise  que  le  niveau 
des  donnies  il  associer  est  proche  du  capteur  Cette  phase 
priliminaire  du  traitement  conditionne  fortement  I'itape  de 
fusion,  Les  rigles  de  fusion  sent  diveloppies  de  fajon  £ 
amdliorer  le  pouvoir  de  classification,  augmenter  la  probability 
de  detection,  utiliser  la  complimentariti  iventuelle  des 
capteurs,  permcttre  une  visualisauon  simultanie  des 
informations  pcrtinentes  IR  et  visible  it  I'opirateur. 

1.1.  Fusion  de  c"onn£es,  fusion  optronique 

La  fusion  d'lnformations  issues  de  senseurs  ditfirents  presente 
les  pnncipales  caractiristiques  suivantes  - 

-  i'accroissement  spatial  et  temporel  du  volume  de  surveillance 
du  £  la  multiplicity  des  senseurs, 

-  I'amilioraton  des  performances,  notamment  par  la  reduction 
des  durees  d'lniualisation, 

-  I'amilioration  de  la  probability  de  ditection 

Dans  le  cadre  de  I'optromque,  on  s'adresse  a  un  signal  de  type 
image  L'opiromque  peraet  d'utiliser  les  bandes  spectrales  les 
plus  favorables  a  la  ditection  (observation  nocturne  (1), 
reduction  de  lelticacitc  des  camouflages)  Elle  autonse 
l'lnteractiviti  entre  l'equipement  d'observanon  et  les 
interprites  de  I'mfomiation  re<('ue  Air.si  le  role  de 
ropirationnel,  a  parlir  de  ces  signaux,  va  etre  de  detecter,  de 
classifier,  de  reconnaltre 

La  fusion  d'infonnations  peut  alors  s'operer  a  ditferents 
mveaux  plus  ou  moms  ilaboris  du  signal  11  est  evident  que 
selon  le  niveau  de  fusion  auquel  on  se  situe,  la  nature  des 
donnies  £  prendre  en  coinpte  ainsi  que  les  techniques  de 
fusion  £  mettre  en  oeuvre  vont  diffirer  On  peut  alors  evoquer 
le  terme  de  hierarchic  dans  1'approche  de  la  fusion  tant  au 
mve^  j  des  donnies  qu'au  niveau  des  nlgonthmes 


--  ^  1  uj-rrs.4-  -wv , 


La  figure  1  1  lllustrc  sommairement  l'aspect  hiyrarchique  dc  la 
fusion  en  giniral  et  optronique  en  particulier  On  distingue  sur 
cette  figure  les  diffirents  mveaux  de  fusion  suivants  .■ 

SIGNAL/PIXEL  donnies  brutes,  recalage  pricis,  filtrage 
et  melange  d'lnformations  pertinentes. 

-  OBJETS  ELEMENTA1RES  ou  ALARMES  .  apris 
ditection,  traitement  sur  zones,  notion  de  rccouvrcment 
spaual,  continuity  temporelle,  mcsurc  de  confiance, 
thione  des  possibilities 

-  PISTES  ELEMENT AIRES  association  d'alannes, 

piidiclion  spatio-temporelle  (ex  fibre  de  Kalman) 

PISTES  ■  calcul  de  distances,  corrilation  de  trajectoires, 
tonction  de  cout 

,  DONNEES  SYMBOL1QUES  classification, 

reconnaissance 

Dans  ce  schima  de  fusion,  la  notion  d'environnement 
interview  au  niveau  du  choix  des  capteurs,  mais  igalcmcm  au 
niveau  dc  la  confiance  £  accorder  aux  cibles  ditccties  dans  un 
contexte  donni  L'informalion  cxtiricure  conccme  tous 
renseignements  permetianr  de  contnbuer  £  une  meilleure 
ivaluation 

Les  travaux  se  siluem  dans  cette  structure  de  fusion 
successivement  au  niveau  des  alarmes,  au  niveau  du  signal 
brut  (pixel)  dans  l'objectif  d  une  reconnaissance  visuelle  el 
enfin  symbolique  en  vuc  d  une  classification  automatique 


Fusion  au 
^niseuu  du 
pixel 

^Fusion  sui 
ulai lues 


fusion  sill 

► 

pistes 

Fusion  sur 
►donnees 
s>  mbuliques 


intos  tslei  leui  es- 


Reconnaissance 

Idcwliticntion 


Fig.  1.1  ■  Fusion  de  capteurs  a  diffirents  niveaux  de 
reprisentations 
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2.  ACQUISITION  AUTOMATIQUE  DE 
CIBLES 


On  utilise  les  bandes  spectrales  IR  8- 12pm  et  visible 
0.4-1/lpm  dans  le  cadre  de  la  fusion  sur  alarmes  Les  alarmes 
(cibles  potentielles)  sont  issues  des  difterentes  voies  de 
traitements  d  un  systdme  de  ddtecUon/poursuite  opdrant  dans 
les  bandes  IR  (2).  Dans  ce  systdme  les  alarmes  sont  suivies 
temporelleraent  (pistage)  et  une  note  (niveau  de  confiance)  est 
attribute  a  chaque  piste.  Les  alarmes  des  pistes  de  metlleurc 
note  sont  envoydes  4  un  module  de  poursuite 


2.1.  Fusion  sur  alarmes  entre  IR  8- 1 2pm  et  visible 

Pour  la  viddo  thermique  on  opdre  par  3  voies  de  traitements  •• 

-  1  voie  destinec  a  la  ddtection  de  cibles  sur  intensity  (chaude 
ou  froide), 

-  1  voie  destinde  4  la  ddtection  de  cibles  sur  le  mouvemcnt, 

-  1  voie  destinde  it  la  ddtection  de  cibles  ponctuellcs. 

Dans  le  cas  de  l'imagenc  visible  sur  fond  de  terre  la  notion  de 
able  chaude  ou  froide  n'a  plus  ndellcment  de  sens,  c'cst-4-dirc 
que  les  voies  lides  au  traitement  par  contraste  ne  sont  plus 
adaptdes.  Cela  a  pour  consdqucnce  de  rdduire  le  pistage  sur 
images  visibles  it  la  voie  opdrant  par  ddtection  de  inouvement. 


Fig.  2.1  -  Pistage  en  bispectral 
2.1.1.  Relation  entre  les  voies  a  detection  de  mouvement 


Pources  voies  de  traitements  (2  et  4  en  fig  2  1)  les  techniques 
retenues  sont : 

-  recalage  en  trames  homologues, 

-  estimation  du  ddplacement  par  condlatton  de  phase, 

-  ponddration  du  spectre  de  la  corrdlation 

La  mdthode  de  recalage  s'avdre  ties  robuste  Cependant,  le 
contexte  opdrauonnei  amdne  4  trailer  des  images  bnntees  et  de 
trds  faible  ddfinition,  qui  font  que  I'estimateur  de  mouvement 
peut  dchouer  dans  I’estimation  du  vecteur  correspondant  au 
ddplacement  du  fond 


Lorsque  I’on  opere  en  bispectral,  il  est  fort  probable  que  l'une 
de  ces  bandes  spectrales  engendre  une  image  de  meilieure 
quantd  que  celle  de  1’autre  bande. 

Ainsi,  lorsque  l'on  tente  de  recaler  des  images  dans  les  deux 
bandes  spectrales,  i>  est  sur  que  le  pic  de  corrdlation  le  plus 
important  en  amplitude  est  issu  des  images  les  plus 
contrastdes.  II  s'avdre  dgalement  que  d'une  fa?on  gdndrale  plus 
un  pic  de  cortdlauon  est  important  en  amplitude  plus  la  valeur 
du  ddplacement  estimd  est  prdcise. 

Ces  diverses  considerations  ont  permis  d'dlaborer  une  gestion 
des  rdsultats  des  estimateurs  de  mouvement  des  images  dans 
les  deux  bandes  en  proeddant  de  la  fa?on  suivante  :■ 

a)  calculer  les  coefficients  de  passage  d'une  bande  spectrale  4 
l'autre  en  ce  qui  conceme  les  vecteurs  de  mouvement, 

b)  valider  les  vecteurs  estimds  par  une  mesure  sur  le  contraste 
en  amplitude  pour  chacune  des  bandes  spectrales, 

c)  sdlectionner  ou  cstimer  un  vecteur  dans  une  bande  par 
rapport  4  un  vecteur  valide  dans  l'autre  bande, 

d)  4  ddfaut  s'appuyer  sur  l'information  dmanant  de  la  ligne 
visde. 

La  ddtection  sur  le  mouvement  est  tdalisdc  entre  une  image  de 
tdfdrcnce  et  1'image  courante.  En  ce  qui  conceme  le  trailemcnt 
bispectral,  le  changement  de  idfdrcncc  est  synchrone  (fonclion 
de  la  valeur  du  ddplacement), 

D’autre  part,  les  coefficients  de  passage  d'un  capteur  4  l'autre 
sont  issus  d'une  opdration  de  calibrage  qui  rdsout  en  panic  les 
problimes  de  mise  en  corrcspondance  inhdrents  4  1'utilisation 
simultande  de  deux  capteurs  sur  une  memc  sedne  supposde 
plane,  4  savoir  .• 

-  la  dif  rence  de  position  des  capteurs, 

-  It ,  diffdrences  de  focales, 

-  les  diffdrences  de  gnlles  d'dchantillonnage 

Ainsi,  le  calibrage  pcrmel . 

-  dassurer  une  bonne  misc  en  correspondance  des  alarmes  ou 
des  pistes  issues  de  sources  diffdrentes  lors  de  la  phase  de 
fusion , 

-  de  recaler  "grossiirement"  les  images  avant  de  fusionner  au 
niveau  du  pixel  tel  que  nous  le  verrons  plus  loin 

2.2.  Pistage 

La  fusion  d'alarmrs  est  dlaborde  avec  un  ensemble  de 
paramitres  de  type  spatial  itaille,  position  dans  1'image,  centre 
de  gravitd,  luminance  moyenne  ) 

Comparativement  au  pistage  en  monocapteur,  on  va  mampuler 
des  alarmes  mixtes  ayant  des  paramdtres  ttlatif  aux  trois 
votes  thermiques  et  4  la  voie  visible. 

Chaque  vote  de  traitement  est  affectee  d'un  poids  au  sens  de  la 
thdone  des  possibihtds  qui  .end  coinpte  de  la  crddibilitd  que 
l'on  peut  accorder  4  la  voie  en  quesuon 

A  tide  d'exemple,  les  alarmes  des  voies  4  ddtection  de 
mouvement  sont  retenues  en  fonclion 

-  du  nombre  d'alarmes, 

-  de  la  ladle  de  I'alarmc, 

■  de  I'dcart  entre  le  vecteur  de  recalage  estimd  et  l'information 
de  la  ligne  de  visde 
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2.2.1.  Fusion  sur  alarmes 


■  Cntire  d'associanon 

En  imagene  IR  on  associait  entre  elks  soit  des  alarmes 
chaudes  soit  des  alarmes  froides.  Comme  on  est  en  presence 
de  deux  capteurs  diffcrcnts  il  faut  done  considdrer  des 
associations  mixtes  A  partir  des  observaoons  faites  sur  les 
images  IR  et  visible;.  les  associations  possibles  qui  ont  (t6 
rctenues  sont  prtsentdes  en  table  2.1. 


Table  2.1  -  Association  aiarme-alarme 


lilflBBBBBBflBBBB 

dbBHHBBB 

gag 

BBBBB 

EBB 

BBB 

BBBBfl 

Egg 

BBBBB 

EBB 

BBB 

BBBBB 

ebb 

BBB 

BBBBB 

Table  2.2  -  Association  piste-alarme 


Une  illustration  de  pistage  en  monocapteurs  et  bispectral  est 
pnSsenke  par  les  photographies  1  et  2. 


Ce  cntcrc  est  valablc  en  intra  et  en  inter-voie  La  notion  de 
cible  chaude  ou  froide  s'expnme  par 

-  moy2  5  128  — *  able  froide  (F) 

-  moy2  >128->  able  chaude  (C) 

oil  • 

moy2  est  la  valeur  moyenne  de  lilarme  calculde  dans  linage 
(kligmSe  telle  que 

moy2  £  (cour  0,8)  -  ECour  (k)  +  128) 
j,k  E  alannc 

avec 

-  Cour  0,k)  correspondant  4  la  valeur  de  luminance  du  point 
0,k)  de  1'image  courante 

-  ECour  (k)  6tam  la  valeur  moyenne  de  la  ligne  k  de  1'image 
courante 


2.2.2.  Fusion  alarme-piste 
Cntire  d'assoaatton 

En  3  voies  themuques,  une  piste  pouvait  etre  rafraichie 
simplement  par  une  alarme  chaude  ou  froide  Dans  notre  cas 
de  4  voies  une  piste  ou  une  alarme  peut  etre  issue  de  •• 

-  alarme  IR  chaude  ou  froide, 

-  alarme  visible  chaude  ou  froide, 

-  d'alamtes  visibles  froides  et  IR  chaudes, 

-  d  alarmes  visibles  chaudes  et  IR  froides 

De  fait  les  combinations  dissociations  envisagees  sont 
donnees  par  la  table  dissociation  2  2 


3.  CLASSIFICATION  DE  CIBLES 


3.1.  Classification  visuelle  bispectrale 

On  abordc  dans  ce  paragraphe,  le  probkmc  de  la  fusion 
d'lmages  au  riveau  du  pixel  Cette  operation  sous-entend  d’une 
pan  la  mise  en  conespondance  des  images  de  fagon  la  plus 
precise  possible,  et  d'autre  pan,  la  fusion  proprement  due  de 
rinformauon  image. 

la  mise  en  correspondance  des  images  4  fusionner  est  kalisde 
en  deux  dtapes  • 

-  la  premiere  effectue  une  correction  grosskre  avec  des 
parametres  approximes  tel  que  cela  est  fan  pour  la  fusion  sur 
alarmes, 

-  la  deuxiime  fan  ce  quin  va  appeler  le  recalage  fin,  qui 
consiste  4  mettre  au  mieux  en  conespondance  les  pixels,  par 
I'inteimediaire  dun  comflateur  de  phase  opdrant  par  blocs 
d'lmages. 

La  fusion  au  niveau  du  pixel  est  traitde  successivement  par  les 
deux  mdlhodes  suivantes  .< 

-  par  pseudo  couleur,  oil  1'image  visible  est  enrichie  par 
lipport  de  I'mformation  IR  dans  le  canal  rouge  d'une  image 
construite  en  RVB. 

■  par  technique  pyramidale  4  partir  du  signal  image. 


3.1.1,  Mist  en  correspondance  des  images 

Le  prtrecalage  effectud  dans  un  premier  temps  donne  entire 
satisfaction  pour  fusionner  des  alarmes  mais  est  apparu 
insuffisant  pour  travailler  au  niveau  du  pixel 

Bien  que  Ton  desire  travailler  au  niveau  du  pixel,  il  est 
indispensable  d'utiliser  les  structures  environnantes  des  pixels 
pour  opdrer  la  mise  en  correspondance  II  convient  de  choisir 
une  nkthode  de  recalage  robuste  qui  se  prtsente  de  la  fafon 
suivante  . 
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-  dicoupage  des  name;  par  blocs  homologues  de  64  points  par 
32  lignes, 

-  conilateur  de  phase  en  pleinc  definition. 

Du  fait  que  Ton  traite  des  images  de  capteurs  diffirents, 
l'utilisation  des  vecteurs  est  conditionnde  k  :• 

-  un  contraste  d'amplitude  entre  le  vecteur  principal  et  les 
4  pics  de  correlation  immidiatement  infdneurs, 

-  un  filtrage  spatial  et  temporel  glissam  des  vecteurs  d'un  bloc 
consider. 

Le  principe  est  dlustii  par  la  fig.  3.1. 


IR.  VISIBLE 


Fig.  3.1  -  Reconstruction  de  I'image  visible 
par  rapport  A  I'image  IR 


3.1.2.  Fusion  par  pseudo  couleur 

Une  fois  les  deux  images  mixes  en  correspondance  une  image 
de  type  RVB  est  commute.  L'tdic  (3)  consiste  k  renseigner 
limage  de  la  seine  par  les  rones  chaudes  de  I'image 
mfrarouge,  bicn  entendu  sans  la  momdre  opi ration  de 
segmentation 

De  fait,  les  canaux  V  et  B  sont  alimentfs  par  limage  issue  du 
capteur  opirant  dans  le  visible,  tandis  que  le  canal  R  contiem 
1  unage  IR  8- 12pm.  Dans  la  mesure  ou  I'on  travaille  avec  des 
images  codfes  en  Y  DR  DB,  il  est  nfeessaire  de  fane  un 
transcodage  Soient  Rir  la  composante  infrarouge  et  Vv,  Bv 
les  composantes  du  visible,  les  nouvelles  valeurs  Y,  DR,  DB 
(cf.  fig.  3.2)  sont  calculies  selon  la  nffitence  (4)  de  la  mamire 
suivante  • 

Y  =  0,299.  Rir  +  0,587.  Vv  +  0,1 14,Bv 
DR  =  0,627.(Rir-Y)  +  128.5 
DR  -=  0,627  <Bv-Y)  +  128.5 

Une  illustration  est  prfsentfe  par  les  photographies  3, 4  et  5 


3.1.3.  Fusion  pyramidale 

Le  principe  envisagi  est  trfcs  different  du  pricident  puisqu'on 
pan  de  mveaux  de  gns  pour  arriver  &  des  mveaux  de  gris,  oil 
l  objecuf  est  d'lntigrer  dans  une  seule  image  les  structures 
contenues  dans  les  deux  images  candidates. 

L'approche  pyramidale  de  la  fusion  au  niveau  du  pixel  est 
pnncipalement  introduite  dans  les  articles  de  rifircnces  (5), 
(6)  et  (7).  Cette  mfthode  utilise  un  schfma  de  fusion 
hifrarchique  des  images  basi  sur  une  structure  pyramidale  de 
filtrage  de  type  laplacien,  laquelle  a  itf  diveloppie 
imualement  par  Bun  PJ  et  Adelson  EH  (8),  (9)  dans  le  but  de 
la  compression  d'images.  Cette  dicomposition  s'appuie  sur  les 
diffirences  locales  de  luminance 

L'algonthme  mis  en  oeuvre  dfcompose  dans  un  premier  temps 
les  deux  images  en  diffirents  mveaux  de  ii solution  tant  en 
gradients  qu'en  valeurs  moyennes  dans  un  deuxihme  temps,  k 
chaque  niveau  de  risolution  sont  compards  les  gradients 
relatifs.  Limage  de  fusion  est  alors  fajonnie,  en  partant  de  la 
plus  basse  risolution,  en  pnvildgiant  les  rone  de  contraste  les 
plus  flevdes  ;  ce  qui  permet  de  silectionncr  les  pnncipales 
smictures. 


-  Cmtaiam tick  eyramiili  de  commie 

La  construction  pyramidale  au  niveau  des  gradients  est 
similaire  i  ce  qui  se  fait  en  pyramide  Laplacienne  (9)  Dans  un 
premier  temps  la  pyramide  Gaussienne,  ou  de  type  passe-bas, 
est  commute.  Cette  pyramide  contiem  alors  des  images  oil 
chacune  d'entre  elles,  est  issue  de  la  prfeddente  apris  un 
filtrage  passe-bas  et  un  sous-dchantillonnage  un  point  sur  deux 
dans  les  deux  directions. 

On  disigne  par  G0  le  ba.,  de  la  pyram.de  qui  correspond  h 
limage  onginale  Chaque  ftage  de  la  structure  est  noti  par 
lindice  1  (1  £  1  £  N  avec  N  lindice  du  sommet  de  la  pyramide) 
L'opiration  de  filtrage  et  de  sous-ichantillonnage  va  etre 
appelie  REDUC ,  ainsi  pour  1  £  l  £  N  -ous  avons  • 

G,  =  REDUC  (G, ,) 

avec  ,2 

G,(i,j)  =  Z  Z  f(n,m)  G, ,  f2i+m,  2j+n) 

ill  n=  2 

Le  filtre  de  taille  5*5  f(m,n)  est  separable  c'est-H-dire 
f(m,n)  =  f(m)  f(n) 
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avec  (9) '■ 
f  (0)  =  a 

f(l)  =  f(-n=  1/4 
f  (2)  =  f  (-2)  =  l/4-a/2 

Du  fait  de  la  recherche  des  structures  contenues  dans  les 
images  it  fustonner,  une  structure  pyramidale  de  contraste  va 
mamtenant  etre  rdalisfe  Pour  un  itage  de  la  pyramide  donni, 
le  pnneipe  consiste  k  calculer  le  rapport  entre  lc  contraste  local 
et  la  valeur  moyenne  locale. 

La  premiere  itape  est  l'inverse  de  la  prfeddente.  en  ce  sens 
qu'on  va  rdalxscr  une  interpolation  ddfime  par 
l'opiration  EXPAND.  La  notation  devient  mamtenant,  G,* 
limage  obtenue  k  parttr  de  G  en  lui  appliquant  k  fois  la 
fonction  EXPAND  d'oii  '■ 

G|o  =  G| 

,  =  EXPAND  (Glk  ,) 
avec 

+2  +2 

G|.k  (i  j)  =  4.X  X  f(n,m)  G(i  ,  ((i+m)/2,  (j +n)/2) 

m,n=-2 

ok  seulement  les  coordonnfes  entities  de  ((i+m)/2,  (j+n)/2) 
contnbuent  au  calcul  de  G,k  (t  j). 

Par  consequent,  on  peut  difinir . 

L,  =  G,  -  EXPAND  (G,„)  avec  0  Si  SN-1 

L„  =  G„ 

Ainsi,  chaque  etage  de  la  pyramide  sous  ceue  forme 
diffirentielle  (L,),  devient  iquivalent  k  une  operation  de 
filtrage  passe-bande  k  caractkre  laplacien.  La  pyramide  en 
partant  du  bas  est  une  representation  complete  de  I'tmage 
originale  G0  qui  peut  etre  rctrouvie  par  reconstruction  inverse 
sous  la  forme  suivante  '■ 

G„  =  L„ 

et 

G,  =  L,  +  EXPAND  (G„|)  avec  0  <  i  £  N- 1 


II  s'agit  d'une  reconstruction  fondle  sur  une  approche  de  type 
diffirenttelle,  en  riaitti  on  va  opirer  plutdt  par  le  biais  du 
rapport  des  gradients  (au  sens  large)  et  de  la  luminance 
moyenne  locale 

-  Fusion  visible  tnfrarmt 

Le  schema  de  fusion  se  resume  k  faire  la  decomposition 
pyramidale  des  deux  images  puis  au  moment  de  la 
reconstruction,  k  selection ner  le  rapport  de  contraste  les  plus 
eieves  pour  un  pixel  situe  k  un  etage  donne  et  cela  jusqu'k  la 
pleine  definition 

Le  entere  de  selection  du  gradient  tient  compte  notamment  de 
la  luminance  locale  en  1R  (aspect  detection) 


On  choisit  une  decomposition  pyramidale  k  5  niveaux,  soit  en 

partant  de  la  pleine  definition  4  niveaux  de  reduction  (N=4)  de 

definition. 

Le  pnneipe  general  de  fusion  est  illustre  en  fig.  3.3  ou  * 

-  les  deux  images  A  et  B  sont  suppos6es  recaiees, 

-  les  differtnts  niveaux  de  resolution  du  point  de  vue  des 
gradients  sont  notes  par  RA3,  RA2,  RA1  et  RAO, 

-  la  premiere  sous-image  (IF4)  qui  permet  d'initialiser  le 
processus  de  fusion  est  igale  k  la  moyenne  des  sous-imagcs 
GA4  et  GB4. 

-  les  image  des  gradients  fusionnes  sont  notes  par  RF3,  RF2, 
RF1.RF0 


Enfin,  en  tenant  compte  des  gradients  et  de  la  sous-image 
fusionnee  interpolec  on  aboutit  k  1'image  fusion  de  A  et  de  B 
en  pleine  definition. 


Fig.  3.3  -  Representation  de  la  fusion  d'images 


Les  photographies  6,  7  et  8  montrem  une  exemple  de  ce  type 
de  traitement. 


3.2.  Classification  automatique 

3.2.1.  Classifitur  neuronal 

Les  alarmes  issues  de  la  detection  doivent  etre  dans  un  premier 
temps  classics  en  terme  de  cibies  et  fausses  alarmes  puis,  les 
cibles  sont  reconnues  scion  leur  catigone,  hilitoptkres  ou 
avion  La  methode  de  classificauon  automatique  mise  en 
oeuvre  dans  notre  application  est  fondie  sur  les  techniques 
neuro  mimitiques 

Ces  techniques  k  base  d'apprenussage  sont  bien  adapties  pour 
rfsoudre  le  problkme  de  classificauon  de  cibles  k  partir  de 
1'image  brute  (l  e  »ans  pretraitement  d'extractiori  des  pnmitives 
caractinstiques  des  objets  k  classcr),  Ainsi,  le  riseau  de 
neurones  mis  en  oeuvre  revolt  en  entree  limagette  32x32 
pixels  codie  sur  256  niveaux  de  grts  reprise ntam  l'alarme  k 
classer.  En  some,  le  reseau  posside  4  neurones  correspondant 
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4  chaque  classe  (avion,  hilicoptire,  cible  en  limite  de  portie, 
et  construction  pour  les  fausses  aiarmes). 

La  descnpnon  de  la  structure  du  tiseau  est  donnie  dans  (10). 
Le  riseau  possidc  une  couche  d’entrie  (e),  une  couche  de 
some  (s)  et  2  couches  cachies  (fig.  3.4). 


avion 

helicoptire 
limite  de  portie 
construction 


Fig.  3.4  -  Riseau  de  classification 


L'opiration  (fig  3  5)  ilimentaire  effectude  au  niveau  J'un 
neurone  est 


►  k 


Dans  le  cas  monosenseur  la  ddcision  consiste  4  choisir  la 
classe  C,  correspondant  au  neurone  de  some  i  oil  y,  est 
maximum 

La  mdthode  est  apphqude  aux  deux  bandes  spectrales  (IR  et 
visible).  Ainsi  pour  une  meme  alarme  vue  par  les  2  capteurs 
(IR  et  visible)  les  classifieurs  neuronaux  associds  RN®.  RN^8 
vont  fournir  les  sorties  y,®  et  ytvss.  Le  but  de  la  fusion  de  ces 
tdponses  est  d'obtenir  une  classification  plus  sure  que  dans  le 
cas  monosenseur. 

3.2.2.  Fusion  dtsclassifkatioi.s 


Em 

m 

■9 

capteur  IR 

capteur  VSB 

,  imVSB 

classifieur 

classifieur  1 

RN 

IR 

RN 

VSB 

yk  =  f(I  a,  e,) 


VSB 


IR 

FUSION 

VSB 

Operation  ilimentaire 

PiJ 

— ► 

P  .  . 

•d 

-  e,  la  lime  entric  du  neurone  K  correspond  4  la  sortie  d  un 
neurone  de  la  couche  ptdcddente. 

-  a,  le  lime  poids  synaptique  associd  a  la  liaison  entre  le 
neurone  k  et  un  neurone  de  la  couche  pricedente 

-  f  est  une  fonction  seuil  de  type  sigmoide  de  fig  3  6 


SELECTION 

— r 


Ci 

Fig.  3.7  ■  Synoptique  de  la  fusion  des  classifications 

Lalgonthme  de  fusion  suit  le  schdma  illustrd  en  fig.  3  7 


-  yk  U  some  du  neurone  k 


La  phase  dappremissage  sur  un  grand  nombre  d'lmagettes 
dtiquetdes  (i.e  de  classe  connue)  permet  d'obtenir  le  jeu  de 
poids  synaptiques  tel  que  la  some  y,(l)  sou  proche  de  +1  pour 
les  avions  et  y,(2),  y,(3),  y,(4)  proches  de  -1,  de  meme  y,(2) 
proche  de  1  pour  les  hdlicoptires,  etc 

En  phase  de  classification,  une  alarme  inconnue  va  produire  en 
sortie  les  valeurs  y,(k)  avec  k  =  1  a  4 


•  Sou  im®  (respecnvement  imVSB)  l'image  de  l'alarme  x  4 
classer  vue  par  le  capteur  infrarouge  (resp.  visible). 

-  L'unagette  infrarouge  im®  (resp.  visible  imVSB)  est  prise n lie 
au  classifieur  infrarouge  RN®  (resp.  visible  RNVSB)  qui 
foumit  en  some  yk®  avec  k=l  4  n  (resp.  ykVSB)  qui  apris 
normalisation,  peut  eat  assimilie  4  la  probabiliti 
d'appartenance  de  x  4  la  classe  k  scion  le  classifieur 
infrarouge  (resp  visible) 

-  D'autre  pan,  le  test  des  classifieurs  sur  une  base  ilargie 
d'exemples  a  permis  d  ilaborer  les  matnces  de  confusion  de 
chacun  deux 

Soil  Pg®  (resp.  P,jVSB)  la  matrice  de  confusion  du  classifieur 

infrarouge  (resp  visible) 

P  reprisente  la  probabiliti  pour  un  classifieur  de  choisir  la 

classe  j  sachant  que  la  cible  prisente  est  i. 

P  reprisente  la  confiance  que  l'on  prete  4  chaque  decision  du 
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classifieur  et  constitue  la  connaissance  a  pnon  qui  est 
introduite  dans  le  processus  de  fusion  de  la  manidrc  suivante  :■ 


Soil  fk  k=l  4  n  le  nfsuitat  de  la  fusion  :• 


k  " 


( i-Y* )  i-pvks; 


VSB 

( 1-Y  '  ) 


1R 


1-P  Y 
k,k  k 

la  selection  est  alors  effectuie  scion  :• 


j__p  VSB  y  VSB 
k,k  '  k 


x  appaitient  &  la  classe  C,,  avec  1  tel  que  f,  =  max  (f) 


de  l'optronique,  est  la  mise  en  correspondance  des 
informations  4  fusionner  qui  se  concretise  par  un  recalage.  II 
est  bien  evident  que  plus  on  remonte  vers  le  capteur,  plus  on 
traite  de  rmformation  brute,  et  plus  le  recalage  doit  etre  precis. 

Hn  definitive  quel  que  son  le  mode  de  fusion  utilise,  on  peut 
affumer  qu'4  des  degrts  divers,  le  multicapteur  apporte 
vraiment  un  plus  par  rapport  au  monocapteur.  II  reste 
cependant  encore  des  travaux  de  developpement  4  effectuer 
sur  la  fusion  au  niveau  du  pixel  par  la  technique  de  filtrage  par 
sous-bandes,  ainsi  que  sur  t'approche  par  fusion  des 
classifications. 


4.  CONCLUSION 

Si  Ton  se  rdffere  4  l'architecture  du  systime  de 
ditecbon/poursuite  (2),  en  ce  qui  conceme  les  traitements  de 
bas  niveau  (filtrages,  recalages)  et  haul  niveau  (alarmes, 
pistes),  it  se  trouve  que  la  fusion  au  niveau  des  alarmes  soit 
bien  appropriie.  En  effet  sur  fond  de  terre,  l'apport  d'un 
capteur  opirant  dans  le  visible  se  traduit  par  l'adjonction  d'une 
voie ; 

Un  des  points  imponants  de  ce  travail  lilt  Ac  relier  les  votes 
opirant  par  detection  de  mouvement  au  niveau  des  processus 
de  recalage,  en  ce  sens  qu'un  estimsteur  de  mouvement  dans 
une  bande  spec  (rale  peut,  en  cas  de  dtficience,  s'appuyer  sur 
les  risultats  de  l'estimateur  de  I'autre  bande.  En  demier  recours 
on  feru  appel  4  l'informadon  imanant  de  la  ligne  de  visde. 

L’approche  de  fusion  au  niveau  du  pixel  par  pseudo  eouleur 
est  du  point  de  vue  visuel  d'un  bon  rapport  perform ance/coOt 
du  fait  de  sa  simplicity  de  mise  en  oeuvre. 

La  technique  de  fusion  pyramidale  prisenie  le  pnncipal 
avantage  de  pr6 server  les  details  fins  de  chacune  des  images. 
Ou  fait  que  1'on  travaille  en  sous-bandes  (signal),  ll  est  tout  4 
fait  possible  d'intervemr  dans  ces  demiires,  en  introduisant 
ties  coefficients  de  pondiration  selon  un  certain  entire. 
Autrtment  dit,  on  peut  favonser  4  souhait  un  capteur  par 
rapport  4  un  autre,  en  intervenant  dans  une  ou  plusieurs 
sous-bandes  spectrales  (signal).  Oans  le  cadre  de  notre 
application,  un  des  entires  retenu  peut  opirer  la  fusion,  a  tie 
de  pnviligier  les  zones  de  1'infrarouge. 

Ce  type  de  fusion  demande  un  recalage  quasi  parfait,  les 
risultats  semblent  momrer  que  les  algonthmes  mis  en  oeuvre 
permettent  d'y  amver.  Cependant  certains  effets  mhirents  ai,x 
capteurs  tels  que  le  trainage,  la  saturation  et  l'iblcuissement 
des  pixels  voisins  ne  som  pas  encore  maitnsis,  Un  des 
problimes  en  suspens  conceme  la  ciiauon  d'anifacts  lors  de  la 
fusion  de  zone  ayant  de  contours  4  contra'  et  inverses  (ex  •• 
botds  de  tott  de  maison). 

Les  risultats  sur  sequences  d'lmages  sent  prometteurs  en  ce 
sens  qu’une  telle  technique  de  fusion  ^informations  peut  itre 
une  aide  4  l'opirateur,  mais  il  est  bien  ivident  que  seul  les 
opirationnels  sont  aptes  4  porter  un  tel  jugement. 

Pour  ce  qui  est  de  la  classification  automanque  pat  technique 
neuronale,  un  deuxiime  capteur  apporte  mcontestablement  une 
dimension  supplimentaire  au  demeurant  fort  utile  pour  lever 
certaines  ambiguttis 
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Le  point  commun  aux  trots  mithodes  de  fusion,  dans  le  cadre 


*K*o  2 .  Source  m  +  PteUt*  (IR+vWMc)  »pr*  fusion 


Photo  8  •  Fusion  p.vramidale 
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DETECTION,  POURSUITE  ET  CLASSIFICATION  AUTOMATIQUES 
EN  IMAGERIE  INFRA-ROUGE 


J.  QUIGNON 

THOMSON-CSF 
Division  Systemes  Electroniques 
9  rue  des  Mathurins,  BP  150 
92223  Bagneux  Cedex 
FRANCE 


1 .  INTRODUCTION 

Cct  article  abordc  certains  aspects  des  techniques 
de  uraitement  d'images  ct  de  reconnaissance  des 
formes  pour  la  detection,  la  poursuite  et  la 
classification  automatiques  de  cibles  en  imagerie 
infra-rouge. 

Lcs  algorithmes  ddcrits  dans  ce  papier  sont  mis 
en  oeuvre  en  temps  riel  pour  des  cibles  avions, 
hdlicoptdres  et  missiles  en  vue  de  leur  integration 
dans  un  dcartombtre  d'un  systdme  de  defense  sol- 
air.  Neanmoins,  il  sont  suffisamment  gdndraux 
pour  6lre  appliques  egalement  aux  equipements 
optroniques  des  systdmes  d'armes  air-sol  et  air- 
air. 

Lcs  traitements  mis  en  oeuvre  sont  de  deux 
categories : 

-  Ceux  qui  portent  sur  tout  le  champ  analyse 
par  le  senseur  (typiquemem  2°  x  3°  pour  une 
camera  thermique  d'un  systems  d'armes  courte 
portec).  Ces  traitements  extraient  du  fond  les 
cibles  potentielles  (appeiees  alarmes).  Les 
enteres  de  segmentation  sont  fondes  sur  le 
contraste  et  le  mouvement  des  cibles  par 
rapport  au  fond ; 

-  Ceux  qui  portent  sur  des  zones  rdduites  de 
1'image  (fenetre  de  poursuite)  et  qui  ont  pour 
but  de  classer  (reconnaitre)  les  cibles 
potentielles  et  de  poursutvre  (localiser  it 
chaque  instant)  les  cibles  reconnues. 

On  prdsente  au  paragraphe  2  les  algorithmes  de 
detection  de  cibles  dvoluant  sur  des  foods  varids. 
Une  technique  de  classification  par  Rdseaux  de 
Neurones  est  pioposde  au  paragraphe  3.  La 
conclusion  ddcrit  la  mise  en  oeuvre  de  ces 
fonctions  dans  une  maquette  temps  rdel  d'un 
dcartomdtre  multicibles. 


2.  DETECTION  D'ALARMES 

Pour  assurer  la  fonction  d'extraction  de  cibles  de 
nature  diffdrentc  (avions.  hdlicoptfcres,  missiles) 
lointaines  ou  prochcs,  dvoluant  sur  des  fonds 
uniformes  ou  texturds,  les  algorithmes  mis  en 
oeuvre  ulilisent  lcs  informatioas  de  contraste  et  de 
mouveme.it.  Les  traitements  associds  h 
1'information  de  contraste  permettent  de  ddtectcr 
des  objets  fixes  ou  mobiles  prdsentant  des 
caracldnstiques  en  luminance  diffdrentes  de  cedes 
du  fond  environnant  (caractbre  plus  chaud  ou  plus 
froid  en  IR). 

Les  traitements  lids  h  l'analyse  du  mouvement 
viennent  compldtcr  les  traitements  ptdeddents  dans 
la  mesure  oil  ils  permettent  de  ddtecter  des  objets 
mobiles  faiblement  conlrastds. 

Pour  couvrir  i'ensemble  des  situations  envisagdes 
trois  algorithmes  de  ddtection  (trois  voies  de 
traitement)  sont  utilises. 


2.1.  Ddtection  de  cibles  ponctuelles 
(voie  1) 

En  iimite  de  portde  (=>  10  km)  les  cibles 
apparaissent  comme  des  sources  ponctuelles 
(quelques  pixels)  localement  contrastees,  animdes 
d'un  trds  faible  mouvement  apparent.  Pour  assurer 
une  ddtection  prdcoce  (rapport  signal  &  bruit 
faible)  l'algoriihme  combine  un  traitement  spaual 
ct  temporel. 

a)  Filtrage  spatial 

gfcy>  |  fnxn  (x.y)  -  fmxm  (x.y)  |  avec  n  <  m  et  fnxn 
moyenne  ponddrde  sur  un  voisinnage  (nxn) 

Les  extrema  locaux  de  1'image  filtrde  g  (x.y)  sont 
retenus  comme  alarmes  potentielles. 


b)  filtrage  temporel 

Les  alarmes  potentiellcs  sont  confirmdes  par 
accunulation  tcmporelle.  Le  traitement  permet  de 
conserver  les  extrema  dus  aux  cibles  qui 
prdsentent  un  faible  mouvcment  apparent  et 
d'dliminer  les  extrema  dGs  aux  pointes  de  bruit 
dont  les  positions  dans  1'image  sont  aldatoires  en 
fonction  du  temps. 

Ct0(.y)=2  C1'1 fcy)+2K*fcy)£  £  cM  (x-n,y-m) 

ou  Kl  est  1'image  des  extrema  G  1'instant  t  el  Cl 
(x,y)  la  valcur  de  1'accumulateur.  Les  pi/els  (x,y) 
ccnnexes  pour  lesquels  C1  (x,y)  atteint  un  scud 
Tj  sont  regroupds  en  alarmes. 


2.2.  Detection  de  cibles  larges  (voie  2) 

Cct  algorithmc  de  detection  est  bien  adaptd  pour  la 
ddtection  de  cibles  contrastdcs  ct  proches.  II  est 
fondd  sur  unc  technique  de  seuillage  adaptd. 

Le  seuil  est  ddtermind  de  la  manidre  suivante : 

son  f  (x,y)  1'image  source  redressde  par  rapport  it 
sa  moyenne  globale  Mg 

g  (x.y)  =  |f  (x.y)  -  fj-  3  (x,y)|  1'imagc  gradient. 

Le  seuil  de  detection  T2  est  dvalud  au  point  xm, 
ym  oil  la  somme  luminance  +  gradient  est 
maximum  et  prend  la  valeur 
T2  =  f  (xm,  ym)  -  a  g  (xm,  ym). 

Les  pixels  (x.y)  connexes  pour  lesquels  f  (x,y)  > 
T2  sont  regroupds  en  alarmes. 


2.3.:  Detection  de  mouvement  (voie  3) 

Sur  les  fonds  terrestres,  qui  sont  par  nature 
texturds,  les  algortthmes  de  ddtection  fondds 
umqucment  sur  le  critdre  de  contraste  engendrem 
des  fausses  alarmes.  Pour  lever  ces  ambiguitds,  la 
segmentation  ctble/fond  est  effectude  sur  un  entire 
de  mouvement.  E.r  effet,  le  paysage  est  ammd 
d'un  mouvement  dG  au  ddplacement  de  la  camdra 
et  les  cibles  se  distinguent  par  un  mouvement 
diffdrent 

On  ptoedde  en  deux  dtapes :  (photo  1) 

a)  Estimation  du  ddplacement  du  fond 

Le  ddplacement  recherchd  est  une  translation  pure 
et  une  mdthode  de  corrdlation  de  phase  peut  ctre 
utilisde : 

soil  fi  (x.y),  f2  (x.y)  =  f-,  (x-dx,  y-dy) 

2  images  successives  et  Fj  (u,v),  F2  (u,v) 
leur  transfonndes  de  Fourier  rcspectives. 


La  transformde  inverse  de  G  (u,v)  prdsente  un  pic 
sttud  en  (xo,  yo)  correspondant  au  ddplacement 
recherchd  (dx,  dy). 

b)  Recalaae  et  diffdrence  d'tmages  recaldes 

Aprds  recalage  de  1'image  f2  par  (dx,  dy)  on 

effectue  une  diffdrence  inter-image 

diff  (x,y)  =  |ft(x,y)  -  f2  «*  <».yJ 

Les  pixels  (x.y)  connexes  tels  que  diff  (x.y)  >  T3 

sont  regroupds  en  alarmes. 

2.4.  Alarmes  et  attributs 

En  sortie  de  chacune  des  voies  de  traitement  les 
alarmes  ddteetdes  sont  caractdrisdes  par  des 
attributs  (position  et  taille  de  la  fei.dtre 
rectangulairc  entourant  au  mteux  l’alarmc,  surface 
en  nombre  de  pixels,  centre  de  gravitd,  intcnsiid 
moyenne  dans  1’image  source,  numdro  de  la  voie 
de  traitement). 

Les  trois  traitemcnis  fonctionnent  en  paralldle  et 
n'ont  pas  un  caractdre  cxclustf.  Atnsi  une  ctble  de 
taille  moyenne  en  mouvement  donnera  lieu  G  une 
alarme  sur  la  voie  2  (ciblc  contrastde)  et  sur  la 
voie  3  (ddtection  de  mouvement).  De  plus,  ces 
alarmes  dues  homologucs  (i.e  correspondant  au 
mdme  objet)  peuvent  donner  lieu  it  des 
reprdsentations  ditfdrentes  du  mdme  objet 
L'exactitude  dc  la  reprdsentation  est  lidc  it 
l'aputude  d'une  voie  de  traitement  G  segmenter 
correctement  1'objet  dans  un  contcxte  donnd 
(contenu  de  la  sedne  ooscrvde).  Le  but  de  la  fusion 
uc  donndes  n'est  pas  de  valider  les  alarmes  en  tant 
que  cibles  mais  d'dvalucr  les  attributs  ''riels"  de  la 
cible  it  partir  des  valeurs  d'attributs  mesurdes  sur 
les  alarmes  homologucs  et  d'une  mesure  de  la 
confnnce  que  Ton  peut  accordcr  it  chacun  des 
traitements  pour  ce  contexte. 


3.  CLASSIFICATION  DE  CILLES 
3.1  Interet  de  la  classification 

L'dtape  de  ddtection  prdeddente  foumit  des  alarmes 
qui  sont  potenliellement  des  cibles  dans  la  mesure 
ou  ellcs  satisfont  au  critdre  de  contraste  (plus 
chaud  ou  plus  froid  que  le  fond)  ou  au  critdre  de 
mobilild  par  rapport  au  mouvement  du  fond  du  au 
ddplacement  du  capteur. 

Dans  un  environnement  de  type  champ  de 
baiaille,  de  nombreux  objets  peuvent  repondre  G 
ces  criidres  :  (photo  2) 

-  les  vraies  cibles  ;  avions,  hdlico,  missiles, 

-  les  fausses  alarmes :  leunes  pyrotechnics, 
feux,  tons  et  constructions,  vdhicu'-s 
terrestres... 


Ce  nombre  important  de  ddtections  peut  saturer 
F2(u,v).  Fi*  (u,v)  les  systdmes  automatiques  et  ne  peut  Stre  gdrd par 

G  (u,v)  =  jp^  p(»  vjj  ia  matrice  de  un  0p£rateur  humain.  La  fonction  de 

corrtlatkm  de  phase.  classification  a  pour  but  initial  de  lever  ces 
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ambiguitds  cn  classant  ces  cibles  potentielles  en 
"able"  ou  "fausse  alarme".. 

Parmi  les  objets  classes  dans  la  catdgorie  "cible” 
la  fonction  classification  permet  de  determiner  le 
type  de  la  cible  en  tenne  d'avion,  d’hdlicoptdrc  ou 
de  missile. 

Cette  nouvelle  information  cst  utilisde  pour 
donncr  une  pnoritd  a  chaque  cible  et  contnbuc  a 
revaluation  de  la  menace. 


3.2.,  Classification  par  reseaux  de  neurones 

La  classification  dc  ciblcs  adncnncs  cn  imagerie 
Infra-rouge  cst  un  probldme  non  trivial.  En  cffet 
lea  signatures  thermiques  des  objets  &  reconnaitre 
sont  trds  varides,  bruitdes  et  souvent  rcprdsentent 
les  cibles  dc  manidrc  incomplete.  Lu  moddlisation 
de  ces  signatures  est  trds  ddlicata  et  Implication 
dcs  techniques  classiques  de  reconnaissance  de 
forme  nc  donne  pas  de  rdsultats  satisfaisants.  Par 
contre  on  pcul  consumer,  au  cours 
d'cxpdrimentations,  unc  base  dc  donndcs 
representative  des  donndcs  d  trailer  cn  enregistrant 
un  grand  nombre  dc  ciblcs  dans  des  situations 
vandcs  et  d'objets  susceptiblcs  de  donner  des 
fausses  alarmes.  Cette  base  dc  donndcs  constitue 
alors  un  ensemble  d'cxcmplcs  dtiquetds.  Les 
mdthodes  fonddes  sur  les  rdseaix  de  neurones 
sont,  grace  d  leur  capacnd  d'apprcntissage  par 
I'exemple,  bicn  adaptdes  pour  rdsoudre  le 
probldme  dc  classification. 


-  structure  de  rdseau  (1) 

,  mdthodc  repose  sur  la  misc  en  oeuvre  d'un 
rdseau  dc  type  "Pcrceptron  Multi  Couches".  Ce 
rdseau  recoil  cn  entrdc  des  sous-unages  de  ladle 
32  x  32  pixels  reprdsentam  I'objct  a  classer. 

Ces  sous-images  correspondent  aux  /.ones 
exiraiics  par  les  traiten.ents  de  detection.  Les 
sorties  du  rdseau  correspondent  aux  4  classes  : 
avtons,  hdlicoptdres,  able  en  liimie  de  portde, 
construction.  La  structure  choisie  cst  unc 
sturcture  d  quatre  couches  enudremem  connectdes 
(fig.  1). 

-  la  couche  d'enude  (E)  de  1024  neurones 
correspond  aux  pixels  dc  1'image  (32  x  32 1 
codds  sur  8  bus, 

-  2  couches  intermdduures,  (I)  dc  100  neurones 
et  (J)  de  30  neurones,  appeldes  couches 
cachdes 

- 1  couche  de  sortie  (S)  comp.  .,  les  4 
neurones  associds  au;;  4  clas*  ■.  possibles  dans 
la  version  actuelle. 


-  Apprentissage 

En  phase  d'apprentissage  4000  imagettes 
dtiquetdes  (exemples)  ont  dtd  prdsentdes  au  rdseau. 
Une  mdthode  d'apprentissage  non-supervisd  de 
type  KOHONEN  permet  l’auto  organisation  des 
donndes  cn  nuages,  puis  la  mdthode  de 
Rdtropropagation  du  gradient  est  appliqude  pour 
obtemr  les  poids  symaptiques  utilisds  lors  dc  la 
phase  dc  gdndralisauon. 


-  Generalisation 

Les  performances  obtenues  cn  gdndralisauon  sur 
un  ensemble  test  (i.e  contenant  rlcs  images  non 
apprises  par  le  rdseau)  sont  de  l’ordre  de  95  %  dc 
bonne  classification  entre  cibles  et  fausses  alarmes 
et  dc  85  %  de  bonne  discrimination  entre  cible 
"avion"  et  cible  "hdhcoptdrc”. 


4.  CONCLUSION 

Sur  la  base  dc  ces  algoritlimcs  dc  detection  la 
maquette  temps  rdcl  d'un  deartomdtre  numdrique 
muluciblcs  (ENM)  a  did  ddveloppdc.  La  foricuon 
de  cet  dquipement,  coupld  a  unc  camdra  IR  on  TV, 
cst  d'assurcr  la  ddlcction  dcs  cibles  et  le  guidage 
d'un  missile  jusqu'd  1'intcrccpiion.  Cette  maquette 
cxploratoire  cst  aclucllcmcnt  cn  test  sur  site, 
interfaede  d  un  systdme  d'arme  courte  portde 
C'ROTALE. 

L’ENM  se  compose  dc  3  modules  principaux 
(figure  2). 

Le  premier  module  assure  la  ddtecuon  mullt- 
algorithmes  ct  le  pistage  dans  lout  le  champ 
analysd  de  20  objets  succpnblcs  d'eue  une  cible. 
L.c  deuxidme  module  assure  la  poursinie  rapide  dc 
4  objets  sdlcctionnds.  Dans  noire  application  ces 
4  objets  seront  2  ciblcs  et  2  missiles  lirds  pour 
interceptor  ces  ciblcs. 

La  fonction  classification  cst  dircctement  lidc  au 
tioisidme  module,  qui  est  un  module  dc 
supervision.  Elle  permet  de  limiter  les  fausses 
alarmes  et  participe  d  la  sdlertion  dcs  cibles 
pnoritaires  d  passer  au  module  de  poursmie  rapide. 

Dans  sa  configuration  actuelle  la  maquette 
travaillc  dans  une  seule  ’'anile  speetrale  Le 
uauement  muln-algoriihincs  cst  applijud  son  a 
la  viddo  mfrarouge  soil  d  la  video  visible. 

Des  dludes  compidmentaires  (2)  sont 
actuellement  mendes  et  visent  it  metire  au  point 
une  technique  de  fusion  muin  speetrale  de 
manidrc  a  utiltser  au  mieux  la  conipldmciunritd 
des  bandes  spectrales  infra-rouge  et  visible  pour 
amdliorer  la  fonction  ddtecuon. 
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Detection  dc  cibles  mobiles  par  corrdlation  dc  phase. 
Photo  1 


Imageues  des  alarmes  h  classer 
Photo  2 
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detection  et  pistage  : 

1  helicoptere  PUMA  (au  centre  ) 

1  camion  cn  mouvement  (a  gauche  ) 
4  cibles  potentielles  (a  droite  ) 


DISCUSSION 


DISCUSSOR  :  Mr  H.W.  PONGRATZ  (Germany) 
(NU) .  Does  the  Neural  Network  use 
directly  the  pixel  data  or  is  there  an 
upfront  feature  extraction  before  the 
trainable  network  ? 

AUTHOR'S  REPLY  : 

(NU)  .  Yes,  the  training  phase  is 
performed  using  the  raw  data,  that  is  the 
grey  value  of  the  pixels  of  the  image. 
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1 .  SUMMARY 

The  Infrared  Targeting  System  (IRTS) 
is  a  technology  demonstration  program 
sponsored  by  the  Avionics  Directorate, 
Wright  Laboratory,  wright  Patterson  AFB , 
OH .  The  prime  contractor  for  this  three 
year  effort  is  Boeing  Military  Airplanes,, 
Wichita,  Kansas.  The  objective  of  the 
IRTS  program  is  to  successfully 
demonstrate  the  mission  performance  that 
can  be  achieved  in  manned  air-to-ground 
targeting  applications  utilising  a 
synergistic  combination  of 
state-of-the-art  active/passive  infrared 
sensor  and  automatic  target  recognizer 
(ATR)  technologies.  The  IRTS  program  is 
centered  around  a  demonstration 
FLIR/Laser  Radar/ATR  (FLASER).  The  FLASER 
consist  of  a  dual  f leld-of-view  (2x2 
degree  and  6x6  degree)  second  generaton 
FLIR  pixel  mapped  to  a  C02  laser  radar, 
with  a  FLIR  ATR  processor,,  a  laser  radar 
ATR  processor,,  and  a  sensor  fusion  ATR 
processor.  In  addition  to  the  FLASER,, 
other  elements  of  the  IRTS  equipment 
configuration  include  a  digital  terrain 


data  base,  FLIR  tracker,  ATRWG  (Automatic 
Target  Recognition  Working  Group) 
standard  recording  equipment,  and  a 
central  control  console.  Following 
construction  and  laboratory  testing  of 
the  IRTS, the  system  will  be  installed  on 
a  test  aircraft  and  demonstrated  in 
flight  against  realistic  Tactical,, 
Strategic,,  and  Special  Operations 
scenarios ., 

2.:  INTRODUCTION 

The  Infrared  Targeting  System  (IRTS) 
is  a  technology  demonstration  effort 
sponsored  by  the  Avionics  Directorate, 
Wright  Laboratory  (WL),  Wright  Patterson 
AFB,  OH.'  The  prime  contractor  for  this 
effort  is  Boeing  Military  Airplanes, 
Wichita,  Kansas.  The  objective  of  the 
IRTS  program  is  to  successfully 
demonstrate  the  mission  performance 
improv"ments  over  current  EO  targeting 
systems  by  utilizing  a  synergistic 
combination  of  state-of-the-art  (SOTA) 
active/passive  infrared  sensor  and 
automatic  target  recognizer  (ATR) 
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technologies  in  an  air-to-ground  manned 
platform  scenario.- 

The  long  term  goals  are  to  develop  a 
FlASER  sensor  for  detecting,  classifying,, 
and  recognizing  tactical  and  strategical 
mobil  targets.  FLASER  (FLIR/Laser  Radar/ 
atr)  as  applied  to  IRTS  is  deplicted  in 
Figure  1.  Future  FLASER  sensors  could  be 
comprised  of  an  integrated  electro  optic 
(EO)  sensor  consisting  of  a 
multifunctional,  multiphenomenology  laser 
sensor,,  a  multispectral  passive  imaging 
system,  and  automatic  target 
cueing/recognition  systems.. 

The  IRTS  sensor  suite  will  consist  of  a 
dual  f ield-of-view  (nominally  2x2  degree 
and  6x6  degree)  second  generation  8  to  12 
micron  band  FLIR  ground  mapped  to  an 
advanced  multi-function  C02  lase,  radar. 
Processors  include  a  FLIR  ATR  processor, 
a  laser  radar  ATR  processor,  and  a  sensor 
fusion  ATR  processor.  Other  elements  of 
the  IRTS  demonstration  configuration 
include  a  digital  terrain  data  base,,  FLIR 
tracker,  ATRWG  (ATR  Working  Group), 
standard  recording  equipment,  and  a 
central  control  console. 

During  the  proposed  IRTS  flight 
demonstration,,  extensive  ground  truth 
collection  is  required  along  with  the 
sensor  imagery..  The  ground  truth 
information  is  necessary  to  support  data 
analysis  to  establish  system  performance 
as  a  function  of  test  conditions. 

Lessons  learned  in  critical  areas  could 
mitigate  risk  in  future  sensor  programs.- 


2.0  TECHNICAL  APPROACH 

2.1  OVERALL  ARCHITECTURE 

Figure  2  shows  a  conceptual  block 
diagram  of  the  IRTS  demonstration  sensor. 
It  consists  of  the  advanced  FLIR  and 
laser  radar,  their  respective  ATRs,,  the 
fusion  ATR,  and  a  FLIR  tracker  and 
electronics.-  In  order  to  facilitate 
ground  mapping,  i.e.,  the  mapping  (not 
necessary  one-to-one)  from  the  FLIR 
narrow  field-of-view  (NFOV)  pixel 
coordinates  to  the  corresponding  laser 
radar  pixel  coordinates,  the  laser  radar 
and  FLIR  must  have,  as  a  minimum,  a 
common  aperture.-  Figure  2  shows  one  of 
the  possible  ways  to  achieve  the  pixel 
mapping;  use  of  a  dichroic  and  a  common 
pointing  mirror.; 

One  of  the  major  characteristics  of 
the  IRTS  laser  radar  is  the  fast  random 
access  mode  which  allows  the  laser  radar 
scanner  to  point  rapidly  to  any  point 
within  the  FLIR  NFOV  and  perform  raster 
scans  of  dynamically  selectable  sizes. 
This  capability  allows  the  laser  radar  to 
interrogate  different  targets  or  take 
multiple  frames  of  data  from  the  same 
target . 

The  purpose  of  the  operator,  depicted 
in  the  'OPERATOR  CONSOLE'  from  Figure  2,, 
is  to  aid  in  area-of -inte i est  (AOl) 
selection  and  to  monitor  the  operation  of 
the  system  during  the  demonstration/data 
gathering  flights. 


Figure  2.  IRTS  Demonstration  Sensor 


A  more  detailed,  high  level  IRTS 
system  architecture  has  been  defined  and 
is  shown  in  Figure  3.  It  shows  all  the 
major  components,  including  the  sensor 
and  ATR  subsystems,  and  their 
interconnects.  A  C-130  is  invisioned  as 
the  airborne  platform  for  the  program. 

The  aircraft  turret  is  depicted  in  the 
figure  for  providing  the  housing  for  the 
sensor  subsystem. 

2.2  Sensor  Subsystems 

The  IRTS  sensor  subsystem  consists  of 
a  boresighted  FLIR  and  laser  radar. 
Initial  systems  engineering  studies 
showed  that  the  FLIR/Laser  Radar  assembly 
should  be  boresighted  so  that  the  ground 
position  of  the  laser  radar  pixel 
information  would  be  known  to  within  one 
FLIR  pixel  ("ground  registered").  This 
requirement  allows  features  detected  by 
the  FLIR  ATR  to  be  matched  spatially  with 
features  identified  by  the  laser  radar 
ATR. 

The  FLIR  will  have  a  wide  and  narrow 
FOV  mode,  with  the  WFOV  mode  3  times  that 
of  the  NFOV  node.  The  FLIR  will  be  an 
advanced  seccid  generation  sensor,  i.e., 
digital  DC  c> upled  output  with  a  minimum 
10  bits  resolution,  non-interlaced,  with 
2  samples  per  IFOV  (Instantaneous  field 
of  view)  in  horizontal  and  vertical 
directions.  The  laser  radar  will  have  a 


fast  random  access  scan  (at  least  10 
targets  of  3m  x  5m  size,  per  second), 
small  beam  size  (<»  O.lmrad),  and  a 
passive  channel  (not  to  be  confused  with 
the  FLIR)..  The  purpose  of  the  passive 
channel  is  to  provide  truly  "pixel 
mapped"  (vs.  "ground  mapped")  data  for 
laboratory  analysis  and  research.-  See 
Figure  4  for  a  block  diagram  of  the 
sensor  subsystem. 

2.3  ATR  Subsystem 

The  ATR  subsystem  consists  of  a  FLIR 
NFOV  mode  ATR,  a  laser  radar  ATR,  and  a 
sensor  fusion  ATR.  Figure  2  depicted  a 
block  labeled  'OPERATOR'S  CONSOLE'.  The 
operator's  input  into  the  IRTS  system  is 
to  act  as  the  primary  detector  and 
classifier  for  areas-of-interests  (AOIs). 
In  a  cost  reduction  effort,  it  was 
decided  to  insert  a  human  operator  into 
the  system  to  locate  AOIs.  These  AOIs  are 
then  passed  to  the  flir  NFOV  mode  ATR  for 
evaluation. 

The  FLIR  NFOV  mode  ATR  acquires  FLIR  NFOV 
mode  sensor  data  at  30  frames  per  second,, 
detects  and  classifies 
objects-of-interrests  (OOI),  with 
confidence  value,  and  provides 
prioritized  lists  of  objects  to  the  laser 
radar  and  sensor  fusion  ATRs.  The  NFOV 
ATR  performs  detection  and  classification 
with  as  few  as  100  pixels  on  target. 


Figure  3.  IRTS  System  Architecture 
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The  laser  radar  ATR  processes  laser 
radar  sensor  data  at  sensor  data  rates, 
identifies  001  (with  confidence  values), 
rejects  non-targets/clutter,  and  provides 
inputs  to  the  sensor  fusion  ATR.  The 
sensor  fusion  ATR  processes  data  from  the 
laser  radar  sensor,  FLIR  NFOV  mode,  laser 
radar  ATR,  and  FLIR  NFOV  mode  ATR  for 
fusion  processing.  As  a  minimum 
requirement,  the  fusion  processor  updates 
the  target  confidences  provided  by  the 
FLIR  NFOV  mode  ATR  with  the  information 
provided  by  the  laser  radar  ATR  at  the 
laser  radar  data  rate.  The  ATR  subsystem 
will  report  FLIR  NFOV  ATR  results  only, 
laser  radar  ATR  results  only,  and  fusion 
of  laser  radar  and  FLIR  NFOV  ATR  results 
for  performance  comparison. 

3.0  DEMONSTRATION  AIRCRAFT 

The  aircraft  initially  chosen  for  the 
IRTS  demonstration  was  the  Airborne 
Seeker  Evaluation  Test  System  (ASETS) 
C-130  aircraft  operated  by  the  3246th 
Test  Wing,  Eglin  AFB  FL.  This  aircraft 
has  a  retractable  turret  which  houses  the 
sensor  subsystem.  The  Field  of  Regard 
(FOR)  of  the  ASETS  turret  is  very  large 
and  more  than  sufficient  to  exercise  all 
the  planned  IRTS  function. 


4.0  IRTS  DEMONSTRATION  SCENARIO  AND 
CONCEPT  OF  OPERATIONS 

The  IRTS  demonstration  flights  will 
be  conducted  at  low  altitude 
(approximately  500  feet)  against  a 
variety  of  targets,  ranging  from 
unconcealed  targets  set  in  a  benign, 
uncluttered  background  to  camouflaged 
targets  set  against  and  within  dense 


clutter.  It  is  helpful  to  consider  the 
nominal  ranges  of  the  demonstration 
flights  to  be  broken  into  3  blocks. 

Figure  5  provides  a  block  discription  of 
the  concept  of  operations. 

4.1  5-10  km  Range 

The  aircraft  will  enter  the 
demonstration  area  in  the  AOI  search 
mode.  In  this  mode  the  operator  will 
search  for  AOIs  such  as  hot  spots,  tree 
lines,  etc.  using  the  FLIR  wide  field  of 
view  (WFOV),  6X6  degrees.  IRTS  will 
develop  a  track  file  on  each  AOI  and 
these  track  files  will  be  handedoff  to 
the  FLIR  NFOV  ATR.. 

4.2  3-5  km  Range 

At  approximately  5  km,  the  operator 
will  lock  the  FLIR  narrow  field  of  view 
(NFOV)  on  the  selected  AOI  via  the  FLIR 
tracker,  and  the  FLIR  ATR  system  will 
begin  looking  for  objects  of  interest 
(OOI’s).  The  FLIR  ATR  will  perform 
segmentation  and  object  detection 
operations  at  30  frames  per  second  on  the 
NFOV  FLIR  image.  Using  a  fast  random 
access  scan,  the  laser  radar  can  provide 
the  range  and  other  supplemental  features 
of  each  OOI  to  the  FLIR  NFOV  ATR.  The 
ATR  will  also  use  information  provided  by 
digital  terrain  maps  and  tactical 
decision  aids  (tda)  to  reduce  false 
alarms.  The  digital  terrain  maps  will 
provide  contextural  information,  and  TDA 
(Tactical  Decision  Aid)  will  provide 
expected  sensor  performance,  i.e., 
expected  detection  ranges,  based  on  the 
input  weather  and  target  information. 
During  the  target  acquisition  process, 
the  FLIR  tracker  will  be  used  to  track 
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5 -10  km 

WIDE  FIELD-OF-VIEW  (WFOV) 
SEARCH  FOR 

AREAS-OF-INTEREST  (AOIs) 


<3Jan 

LASER  RADAR 

IDENTIFICATION  OF  TARGETS 


3-r.5km 

NARROW  FIELD-OF-VIEW  (NFOV) 
RECOGNITION  OF 
OBJECTS-OF-INTEREST  (OOls) 


Figure  5.  Concept  of  Operations 


the  OOI  to  keep  the  FLIR  NFOV  pixels 
registered  to  within  a  pixel  from  frame 
to  frame.  This  tracking  information  will 
oe  used  to  facilitate  pixel  mapping 
between  the  FLIR  NFOV  mode  and  the  laser 
radar . 

4.3  Less  Than  3  km  Range 

When  the  range  to  the  chosen  OOI 
closes  to  approximately  three  kilometers,, 
the  laser  radar  will  begin  imaging  the 
chosen  OOI.-  The  registration  of  the 
laser  radar  pixels  to  FLIR  pixels  will  be 
such  that  the  laser  radar  will  only  need 
to  scan  the  detected  target  plus  a 
minimum  of  additional  background  pixels 
as  necessary  to  ensure  that  the  total 
target  is  covered  and  enough  background 
is  covered  to  satisfy  the  requirements  of 
the  sensor  fusion  ATR.  The  results  of 
the  laser  radar  ATR  will  be  reported  to 
the  operator  in  flight.  Due  to  budget 
constraints,  full  FLIR  ATR  processing  and 
sensor  fusion  processing  will  be 
conducted  post  flight. 


5.0  PROGRAM  STATUS 

Boeing  Military  Aircraft  (bma)  is  the 
prime  contractor  for  IRTS.  BMA  issued  a 
Request  For  Quote  (RFQ)  in  August  1990 
soliciting  sensor  subsystem  and/or  ATR 
subsystem  proposals  for  IRTS,;  At  that 
time  a  48  month  program  was  envisioned.- 
Several  companies  responded  with  sensor 
and/or  ATR  proposals.-  In  January  91  the 
Air  Force  severely  reduced  the  funding 
level  of  the  program  for  FY91,  providing 
only  a  "keep  alive"  level  of  funding.- 
This  level  of  funding  allows  BMA  and  the 
sensor  and  ATR  subcontractors  to  work  on 
system  concept  trade  studies  and  design 
issues.  If  funding  becomes  available  in 
FY92  the  program  will  be  ramped  up,  with 
an  anticipated  30  month  program  ending  in 
mid  FY94. 

The  sensor  subsystem  contract  was 
recently  awarded  to  Hughes  Aircraft 
Company,  Electro-Optical  and  Data  Systems 
Group,  El  Segundo,  CA.  The  ATR 
subcontract  was  awarded  to  Honeywell 
Systems  and  Research  Center,  Minneapolis 
MN. 


•  DUAL  FOV  FUR  FOR  WIDE  AREA  SEARCH  AND 
TARGET  DETECTION,  RECOGNITION,  AND 
PRIORITIZATION 

•  HIGH  RESOLUTION  LASER  RADAR  FOR 
TARGET  IDENTIFICATION 

•  FUR,  LASER  RADAR,  AND  SENSOR  FUSIG. '  ATR 
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6.0  CONCLUSION 

The  purpose  of  IRTS  is  to  demonstrate 
the  performance  improvements  which  can  be 
obtained  by  combining  advanced  FLIR  and 
laser  radar  sensors  and  ATRs.  The 
program  emphasizes  integration  of 
advanced  sensors,  processors,  and 
algorithms.  To  minimize  risk  and  cost, 
existing  sensors,  processors,  and 
algorithms  are  to  be  used  wherever 
possible.  IRTS  is  a  preliminary  step 
toward  the  flaser  sensor  concept. 

DI8CU88ION 

1.  niSCUSSOR:  Mr  D.LEVAILLANT  (France) 

(NU)  . 

1)  What  kind  of  Aircraft  is  planned  for 
the  flight  test  of  the  FLASER  ? 

2)  What  is  the  expected  CPU-Power  for 
ATRs  processing  ? 

AUTHOR'S  REPLY! 

(NU)  . 

1)  C-130  is  planned  as  a  testbed  A/C. 

Miniaturization  of  components  is  not 
required  to  fit  into  pod  size  during 
this  phase  of  the  program. 


2)  The  actual /expected  CPU-Power 
requirements  for  ATR  processing  is 
limited  to  what  is  available  on  the 
ASETS  (C-130)  A/C. 

2.  DISCUSSOR:  Mr  M. JACOBSEN  (Germany) 

(NU) .  Can  you  comment  on  the  performances 
of  the  LASER  RADAR  under  various  weather 
conditions  ? 

AUTHOR'S  REPLY  : 

(NU) .  Naturally  high  humidity  will 

attenuate  the  laser,  but  specifically  we 
are  estimating  a  3dB/Km  attenuation  of 

the  signal  in  fog  conditions. 

3.  DISCUSSOR:  Mr  J.  DAN8AC  (Frame) 

(NU)  . 

1)  Le  RADAR-LASER  utllise-t-il  un 

Laser/C02  ? 

2)  La  detection  est-elle  heterodyne  ? 

&UTHQR '  8  RBPItTf: 

(NU)  . 

1)  Yes,  it  is  a  C02  Laser. 

2)  No,  for  the  moment,  it  is  not 
Heterodyne  detection.  It  will  be  in 
future. 
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AIRBORNB  EXPERIMENTAL  FLIR  PROGRAM 


Klaus  F. Booking 
Carl  Zeiss  /  Germany 
P.O.Box  1380 
W-7082  Oberkochen 
Germany 


Summary 

The  German  Air  Force  has 
decided  to  build  a  FLIR  system 
in  order  to  derive  and  to 
consolidate  the  different 
technical  requirements  for 
their  different  tactical  tasks. 

Under  a  contract  of  the  German 
Mod  this  FLIR  system  was 
designed  and  built  on  the  basis 
of  available  and  proven 
technologies.  The  equipment  is 
pod-mounted  inorder  to  avoid 
modification  of  existing 
TORNADO  aircraft. 

Two  different  modes  of 
operation  are  comprised  in  one 
hardware.  These  are: 

o  Navigation  Mode;  as  a 
pilot  aid  for  flying  at 
night  and  in  adverse 
weather 

o  Fire  Control  Mode;  for 
passive  targeting  and 
navigation-update 

The  mechanical  and  optical 
design  will  be  presented  as 
well  as  the  electronics 
architecture.  The  performance 
of  the  sensor  system  will  be 
described. 


1.  Introduction 

The  Experimental  Flir  System  is 
based  on  a  concept  established 
in  1986  and  designed  to  be 
flown  under  a  TORNADO  aircraft 
in  an  external  pod  (Fig.  1) . 

The  imaging  part  is  based  on 
improved  Common  Module  (CM) 
technologie  with  a  digital  scan 
converter  as  a  video  signal 
transformer  of  the  IR  scene. 

The  main  goals  of  the  program 
are  summarized  in  the 
following: 


Navigation  Mode: 

The  pilot  shall  be  assisted  by 
a  thermal  image  during  night 
and  adverse  weather  operations. 
Flight  test  with  a  Helmet 
Mounted  Display  shall  be 
supported. 

Fire  Control  Mode: 

For  position  update  prior  to 
weapon  release  a  position 
update  with  the  radar  is 
performed.  In  order  to  reduce 
detection  probability  this 
active  procedure  shall  be 
replaced  by  a  passive  one.  The 
passive  system  is  an  IR-system 
with  the  functions  "target 
tracking"  of  well  known  targets 
(e.g.  way  points)  and  "passive 
ranging"  on  the  basis  of 
triangulation. 

The  hardware  is  in  the  final 
integration  phase  and  will  be 
flown  in  early  1992  on  a  German 
test  range. 


2.  Mechanical  and  optical 
Design 

The  design  was  determined  by 
some  major  technical 
reqirements 

o  use  of  available 

technologie  and  components 
to  reduce  risk 

o  two  different  modes  of 
operation 

*  navigation  aid 

*  fire  control 

o  large  field  of  view 

o  long  detection  range 

o  pod  mounted 

o  provisions  for  future 
update 
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This  led  to  a  modular  design 
with  4  main  modules: 

o  Stabilized  Flir  Sensor 

o  Infrared  Imaging  Unit 

o  Pod  Section  (government 
furnished) 

o  Electronic  Part  with  5 
electronic  boxes 


2.1  Stabilized  FLIR  Sensor 

The  Stabilized  FLIR  Sensor 
(SFS)  in  shown  in  Fig.  2  in 
detail,  while  Fig.  3  gives  a 
more  simplified  view  of  the 
SFS. 

The  SFS  is  fixed  mounted  on  the 
rotating  part  of  the  roll- 
gimbal  with  unlimited  rotation 
(n  x  36o” )  with  respect  to  the 
x-axis. 

Within  the  roll-gimbal  there  is 
the  elevation  assembly.  The 
elevation  axis  is  perpendicular 
to  the  roll-axis.  It  has 
unlimited  freedom  of  (n  x 
360’)  . 

The  most  inner  part  of  the  SFS 
is  a  stabilized  mirror  with  two 
degrees  of  freedom.  This  mirror 
is  controlled  by  the 
stabilization  control  loop, 
while  the  elevation  assembly  is 
only  slaved  to  the  elevation 
motion  of  the  mirror. 

The  incoming  radiation  passes 
the  entrance  window  and  is 
reflected  from  the  mirror  out 
of  the  elevation  assembly. 
Thereafter  the  beam  is  in  the 
rolling  part  of  the  head- 
assembly.  It  passes  through  two 
telescopes.  One  of  them  is 
designed  as  a  magnification 
changer. 


The  magnification  changer 
produces  3  different  Fields  Of 


View 

(FOV) .  These  are 

o 

Navigation  -  Mode 
10.7*  x  14.3* 

o 

Fire-Control-Mode 
5.0*  x  6.6* 

(medium) 

o 

Fire-Control-Mode 
1.66*  x  2.21* 

(narrow) 

For  special  missions,  mainly 
for  flight  tests  with  a  Helmet 
Mounted  Display  (HMD) ,  a  fourth 
FOV  is  realized.  The  FOV  is 
specified  with  16.8’  x  22.4*. 
When  this  FOV  is  flight  tested, 
part  of  the  optical  system  is 
removed  and  replaced  by  other 
optical  elements. 

Between  the  magnification 
changer  and  the  second 
telescope  a  special  optic  is 
installed  to  control  focus. 
Defocussing  happens  because  of 
two  reasons.  One  is  the  normal 
geometrical/optical  blurring 
and  the  other  reason  is  focus 
movement  of  the  Germanium- 
optic.  There  is  an  special 
digital  control  loop  to 
compensate  both  effects.  The 
output  of  the  control  loop 
moves  a  lens  to  refocus  the 
image . 

In  the  intermediate  focal  plane 
of  the  second  telescope  system 
there  are  the  Thermal  Electric 
Coolers  (TEC)  which  give  a 
reference  temperature  to  the 
dc-restauration  system  for 
black/white  clamping. 

Before  leaving  the  rotating 
part  of  the  sensor  head  the 
beam  passes  an  image  derotation 
prism.  This  prism  is  needed 
because  an  elevation  movement 
of  the  inner  axis  causes  an 
image  rotation.  This  image 
rotation  has  to  be  compensated 
for. 
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With  two  exceptions  the  optic 
is  manufactured  of  Germanium 
(Ge) .  The  material  for  the 
entrance  window  is  Zinc-Sulfid 
(ZnS)  and  that  of  the  image 
derotation  prism  is  Gallium- 
Arsenid  (GaAs) . 

Within  the  fixed  part  of  the 
head  assembly  there  is  the 
Infrared  imaging  System  (IIS) . 


2.2  Infrared  Imaging  System 

The  Infrared  Imaging  System 
(IIS)  consists  of 

o  the  scanner 

o  the  Germanium  lens  system 

o  the  detector/cooler 

assembly 

Basis  of  the  IIS  is  the  US- 
Common-Moaule-Technologie  (CM) 
for  thermal  imaging  equipment. 
Some  modifications  have  been 
made  to  the  US -CM  components. 

The  US-CM  System  uses  a  scanner 
with  a  2:1  interlace  with  the 
result  that  the  number  of 
videolines  is  twice  as  much  as 
the  number  of  detector 
elements. 

In  this  program  a  better 
resolution  was  required.  To 
meet  this  requirement  a  4:1 
interlar  i  was  developed.  Thus 
the  145  detector  elements  give 
580  TV  lines,  which  in  fact 
meets  the  European  TV  standard 
CCIR.  The  4:1  interlace  gives 
better  resolution  and  better 
range  performance. 

The  line  sequence  is  as 
follows: 

On  the  first  forward  stroke  the 
1.  video  line  is  generated.  On 
the  first  fly-back  the  3.  line, 
on  the  second  forward  stroke 
the  2.  line  and  on  the  second 
fly-back  the  4.  video  line  is 


generated. 

The  Germanium  lens  system 
focusses  the  IR  radiation  on 
the  IR  detector  array. 

The  detector/cooler  assembly 
consists  of  the  IR  detector  and 
a  linear  drive  cooler.  The 
detector  is  an  array  of  145 
elements.  These  elements  are 
cooled  by  a  linear  drive  cooler 
down  to  77  Kelvin. 

To  generate  a  video  signal  from 
the  detector  signals  a  Digital 
Scan  Converter  (DSC)  is  used. 
Apart  from  producing  a  video 
signal  in  CCIR  standard  the  DSC 
has  the  following  functions: 

o  automatic  gain  and  level 

o  automatic  image 

optimization 

o  black/white  clamping 


2.3  Stabilization 

The  stabilization  control  loop 
has  different  functions  in  the 
different  modes  of  operation  of 
the  aircraft: 

o  fixed  line  of  sight  (LOS) 
o  pointed  LOS 


2.3.1  Fixed  LOS 

In  the  navigation  mode  the  Flir 
video  is  displayed  on  the  Head- 
Up-Display  (HUD) .  In  order  not 
to  confuse  the  pilot  the  Flir  - 
FOV  has  to  be  the  same  as  the 
HUD-FOV  and  the  LOS  must  be 
fixed  with  respect  to  the 
aircraft  reference  system. 


2.3.2  Pointed  LOS 

The  LOS  is  not  fixed  to  the 
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aircraft  reference  system 
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a  pure  inertial 

stabilization  without 

pointing,  but  with 
compensation  of  earth  rate 
and  transport-rate 

o  external  LOS  control 
performed  by 
video  tracker  or  Helmet 
Mounted  Sight  (HMS) 

o  computer  tracking  executed 
bv  the  FLIR  computer  with 
the  knowledge  of  target 
location  and  own  ships 
movement 

O  range  calculation  and 

position  update  viw-out 
radar  operation  by 
triangulation 


2.3.3  Inertial  Stabilization 

The  stabilization  control  loop 

for  inertial  stabilization 
mainly  controls  the  stabilize 
mirror  with  respect  to  two 
axes. 

The  stabilized  mirror  has  an 
angular  freedom  in  elevation  of 
n  x  360*  and  +/-  10*  m 
azimuth.  As  a  reference  for  the 
LOS  stabilization  a  dynamically 
tuned  gyro  (DTG)  is  used.The 
DTG  is  directly  mounted  on  the 
stabilized  mirror  gimbal. 

Resolvers  are  used  to  measure 
the  displacement  with  respect 
to  the  housing.  These  resolv 
signals  are  used  to  close  LOS 
control  loops.  For  P01^n9 
angles  in  azimuth  greater  than 
+/-  10*  the  roll  gimbal  is 
activated. 


As  soon  as  the  stabilized 
mirror  moves  in  azimuth  the 
roll  gimbal  is  slaved  to  thi 
movement.  The  more  the  roll 
gimbal  overtakes  azimuth 
pointing  function  the  azimuth 
position  of  the  stabilized 


This  mechanization  is  needed  to 

meet  high  dynamic  requirement 
which  can  not  be  met  with  th 
slow  roll  gimbal  .  d 

Therefor  there  is  a  stabilized 
mirror  for  the  high  dynamic 
motion  and  the  roll  gimbal  for 


3.  Electronic  Architecture 


Fig.  5  shows  the  block  diagram 
of  the  Experimental  Flir  with 


components . 
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3.1  FLIR  Computer 

The  FLIR  computer  (FC)  is  the 
central  part  of  the 
electronics.  The  processing 
unit  is  a  Motorola  MC  68020  CPU 
running  at  16  MHz.  In  order  to 
accelerate  the  mathematical 
computation  an  arithmatic 
coprocessing  unit  MC  68081  is 
used.  Because  of  the  good 
multiprocessor  capability  a 
VME-— as ,was  selected  as  the 
intt-na'.  communication  bus. 

The  software  is  written  in  C 
because  of  the  severe  time 
constraints  that  could  not  be 
satisfied  with  an  Ada  program. 
The  program  consists  of  the 
follov/ing  5  main  modules 

o  oos  control  with  pointing 
functions  commanded  by  the 
pilot,  image  derotaion  and 
switching  the  fields  of 
view 

o  Passive  Ranging  carried 

out  by  a  procedure  that 
uses  LOS  angles  for  range 
computation.  A  triangel  is 
determined  (Fig.  6}  by  two 
aircraft  positions 
(distance  of  several 
seconds)  A  and  B  and  a 
fixed  well  known  target  C 
I  on  the  ground  (  e.g.  way 

point) .  Knowing  two  angles 
6  1  and  6  2,  one  at 
aircraft  position  now  and 
one  several  seconds  ago, 
and  the  distance  between 
the  two  aircraft  positions 
c  the  range  to  the  target 
can  be  calculated. 

o  Computer  Tracking 

The  LOS  is  permanently 
pointed  on  to  the  target 
by  calculating  LOS 
command.  LOS  command  is 
derived  from  known  target 
position  and  aircraft 
movement.  To  get 
aircraft  position  and 
velocity  a  Laser  Inertial 


Navigation  System 
(LINS)  is  pod  mounted. 

o  Built  in  Test 

Dependent  on  the  actual 
mode  of  the  FLIR  system  a 
selftest  is  carried  out 
and  reported  to  the  pilots 
display. 

o  Monitoring 

This  is  a  special  mode  for 
on-ground  testing  of  all 
functions  the  FLIR 
computer  hat  to  execute. 


3.2  LOS 

The  components  of  the  LOS 
stabilization  consist  of  torque 
motors,  resolvers,  dynamically 
tuned  gyros  and  the  image 
derotaion  prism. 


3.3  LOS  -  Control 

This  block  comprises  the 
analogue  hardware  for  the  LOS 
control  loops.  In  Fig.  7  a 
typical  control  loop  is  shown 
for  the  azimuth  stabilization 
loop  as  an  example. 


3.4  TI/DSC/AF 

The  subsystems  IIS,  DSC  and 
autofocus,  already  desrcibed 
earlier,  are  combined  in  that 
block. 


3.5  FCP/FHC 

The  FLIR  Hand  Controller  (FHC) 
and  the  FLIR  Control  Panel 
(FCP)  are  located  in  the  rear 
cockpit  for  FLTR  operation 
(Fig.  8). 


I 


3.6  Video  Tracker  4.2  Stabilization  and  Pointing 

This  is  a  subsystem  to  control 
the  LOS  so  that  it  stays  on  a 

designated  target.  4.2.1  Field  of  Regard 

Elevation  +20'  /  -120" 

Azimuth  +90*  /  -  90* 

3.7  LINS/MI LBUS 

The  LINS  is  used  to  give  data 

of  aircraft  position  and  4.2.2  LOS  speed 

veeocity  for  computer  tracking. 

The  interface  between  FC  and  Elevation  0.2  mrad/s  /  2  rad/s 

LINS  is  a  Mil  1553/B-Bus  with  Azimuth  0.2  mrad/s  /  2  rad/s 

the  FC  as  the  master. 


4.  performance 

4 . 1  Modes 

The  following  modes  are 
realized: 

o  Navigation  Mode 

*  fixed  great  FOV 

*  stow  position  for 
protecting  the 
entrance  window 

*  no  image  derotation 

*  LOS  stabilization  on 
request 

o  Fire  Control  Mode 

*  inertial  stabilization 

*  3  FOV 

*  steerable  LOS 

*  image  derotation 

*  triangulation  for  passive 

ranging 

*  computer  tracking 


4.2.3  Pointing  Accuracy 

Elevation  0.1  mrad  (+20V120*) 
Azimuth  0.1  mrad  (+10V10') 

4.2.4  Stabilization  Accuracy 

Elevation  0.05  mrad 

Azimuth  0.05  mrad 

4.3  Infrared  Imaging  System 


4.3.1  Entrance 

FOV  #1 
FOV  #2 
FOV  #3 
FOV  #4 


Pupil 

180.0  mm 
75.0  mm 

34.8  mm 

21.8  mm 


4.3.2  Fields  of  View 

FOV  #1  1.66’  x  2.21* 

FOV  #2  5.0  ‘x  6.6  * 

FOV  #3  10.7  ’  x  14.3  * 

FOV  #4  17.1  •  x  22.6  * 
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Fig.  V  Azimuth  Stabilization  Loop 


Fig.  Q  FLIR  Control 
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DISCUSSION 

X.  DISCUSSOR:  Mr  J.  DANSAC  (France) 

(NU)  .  Vou  have  shown  a  table  on 
Identification,  Recognition, 
Classification,  Ranges,  etc...  What  is 
the  type  of  target  ? 

APTHOR'B  REPLY  : 

(NU)  .  The  target  for  the  shown  range 
calculation  is  a  shelter. 

2.  DISCUSSOR:  Col.  MATHE  (France) 

(NU)  .-  Ddveloppez-vous  un  Viseur/Visuel  de 
casque  specif ique  pour  votre  programme 
FLIR  ? 

AUTHOR'S  REPLY  : 

(NU) .  Actually,  there  is  no  development 
for  a  specific  HMD  at  CARL  ZEISS.  A  Data 


Interface  (MIL.  1553. B  bus)  and  a  Video 
Interface  (CCIR-Standard  ;  STANAG-33501 
are  provided. 

3.  DISCUSSOR:  Mr  T.  FERRE  (France) 

(NU) .  Pouvez-vous  prSciser  la  mani^re 
dont  est  rfealisfee  la  dirotation  d' image. 
Est-ce  optique  ou  par  le  biais  d'une 
transformation  numSrique  ? 

AUTHOR'S  REPLY  : 

(NU) .  In  order  to  compensate  for  image 
rotation  caused  by  LOS  movement,  the 
Elevation  angle  is  measured  and  read  into 
the  FLIR  computer.  A  digital  control  loop 
operates  the  derotation  prism.  For 
compensation  of  the  influence  of  the 
aircraft  movements,  the  appropriate 
aircraft  angles  are  transformed  into  COS 
REFERENCE  system. 
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THE  GERMAN  ANTI  TANK  HELICOPTER  PAH  2  - 
AN  EXAMPLE  OF  A  FUTURE  SENSOR  PLATFORM 

Dr.  R.  Schranner 
Dr.  K.  Rtiskamp 
Dr.  H.-D.  V.  Bohm 
Helicopter  Division 
MBB/DASA 
PO  Box  80  11  40 
D-8000  Miinchen  80 
Germany 


SUMMARY 

The  german  antitank  helicopter  PAH  2  is  presently  under  full  scale  development,  together  with  the  french 
antitank  helicopter  HAC  and  the  french  support  helicopter  HAP,  in  a  cooperation  between  Germany  and 
France.  It  represents  the  current  state  of  the  ait  concerning  target  acquisition  and  fire  control  systems  for 
helicopters  in  Europe. 

The  targeting  system  consists  mainly  of  a  mast  mounted  platform  housing  several  sensors  operating  in 
different  spectral  ranges.  It  is  used  for  the  detection,  recognition  and  identification  of  targets  at  increased 
ranges  as  well  as  to  aim  and  guide  2nd  and  3rd  generation  anti  tank  missiles.  Further  sensors  and  systems 
are  available  to  support  the  crew  in  target  acquisition  or  detection  of  threats  in  the  battlefield  and  to  support 
coordination  of  several  helicopters  in  a  flight,  resp.  the  tasks  of  the  flight  leader  and  his  coordination  with 
the  command  post. 


1.  INTRODUCTION 

The  task  of  the  PAH  2  is  to  support  ground  troops 
in  the  tasks  of  defending  their  territory  against 
armoured  vehicles  in  order  to  build  up  a  concen¬ 
tration  of  defensive  forces.  This  task  is  done  by  one 
or  several  flights  under  control  and  planning  of  the 
regiment  headquarters  who  orders  such  operations  to 
the  support  of  a  specific  brigade  or  battalion  in  his 
area  of  operation.  A  flight  consisting  of  seven 
helicopters  including  the  leader  coordinates  with  the 
brigade  or  battalion  and  internally  to  cover  the  area 
of  operation. 

As  a  result,  the  task  and  functions  of  a  PAH  2  are 
depending  on  several  levels  of  integration:  Primarily, 
the  information  of  the  systems  and  sensors  onboard 
have  to  be  coordinated  and  integrated  to  provide 
sufficient  and  clear  information  to  the  crew  consi¬ 
sting  of  a  pilot  and  a  commander  to  perform  their 
primary  mission  task.  As  part  of  this  level  of 
integration  also  information  from  other  members  of 
the  flight  and  the  flight  leader  may  have  to  be 
considered.  At  the  highest  level  the  flight  leader 
ensures  integration  of  the  information  gathered 
during  the  mission  to  the  overall  operations  planning 
of  the  regiment  and,  vice  versa,  ensures  flow  of 
information  regarding  the  updated  overall  tactical 
situation  for  the  individual  helicopters  as  far  as  it  is 
relevant. 

Consequently,  the  avionic  system  layout  has  to 
consider  these  various  levels  of  "integration": 


-  targeting  sensor  level 

-  avionic  system  level 

-  operations  level. 

This  paper  will  provide  some  detail  information  on 
the  avionic  system  of  the  PAH  2,  the  german 
variant  of  the  TIGER  weapon  system,  with  special 
regard  of  am.  aspects. 


2.  AVIONIC  SYSTEM  LAYOUT 
2.1  General 

The  general  architecture  has  to  take  into  account  the 
functional  requirements  for  the  variants  (anti  tank 
PAH  2,  HAC  and  protection  HAP)  and  -  at  the 
same  lime  -  some  national  differences  in  comm/nav 
equipment.  Thus,  the  avionic  system  of  the  PAH  2 
is  consisting  of  a  distributed  network  of  intelligent 
subsystems  arranged  in 

-  a  basic  avionic  system,  including  the  bus/display, 
communication,  autonomous  and  radio  navigation, 
electronic  countermeasures  and  flight  control  sub¬ 
systems 

-  a  mission  equipment  package  (MEP)  which  in¬ 
cludes  the  antitank  subsystem  (MMS,  PARS3  and 
HOT  armaments),  the  pilot  vision  subsystem 
(thermal  imager  and  HMS/Ds),  A/A  subsystem 
Stinger  and  the  MEP  management  subsystem  (com¬ 
puter  and  controls). 
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The  bus  structure  is  based  on  ME-  1553B  with  two 
fully  redundant  controllers  for  each  bus  (BCSG  for 
basic  bus  and  MCSG  for  MEP  bus).  In  addition,  the 
BCSGs  are  serving  as  main  controllers  of  the  basic 
avionic  system  to  ensure  the  moding  and  monitoring 
of  the  overall  system.  Information  from  utility 
systems  (e.g.  hydraulics,  fuel,  electric,  engines)  is 
collected  via  2  interface  units  (RTUs)  to  allow 
monitoring  of  those  systems  for  operational  purpose 
(by  the  crew  during  the  mission)  and  maintenance 
purpose  (by  recording  defects  on  a  data  earner  for 
post  flight  evaluation). 

2.2  Subsystem  Description 

-  NAVIGATION:  The  navigation  subsystem  is  based 
on  a  strapdown  system  (laser)  with  doppler,  radar 
altimeter  and  air  data  sensors  as  additional  sensors. 
The  raw  sensor  data  are  hybridized  in  the  strap- 
down  computers  to  provide  the  data  for  display 
and  for  manual  and  automatic  flight  control.  Low 
Airspeed  is  calculated  within  the  Strap  down  com¬ 
puters  using  flight  control  position  sensors.  We  are 
presently  investigating  the  integration  of  a  GPS 
system. 

-  FLIGHT  GUIDANCE  AND  CONTROL:  The  flight 
control  system  is  based  on  mechanical  controls.  In 
addition  a  digital  duplex  flight  control  system  with 
limited  authority  is  available,  which  provides  - 
apart  from  basic  stabilization  and  command  aug¬ 
mentation  functions  (CSAS)  -  a  variety  of  higher 
(autopilot)  modes  .  Thus,  the  crew  will  be  sup¬ 
ported  in  all  mission  phases  (cruise,  transition, 
NOE,  hover,  etc.)  by  appropriate  automatic 
functions  in  order  to  reduce  workload. 

-  ELECTRONIC  COUNTERMEASURES:  As  a  basis 
for  future  extensions  a  radar  and  laser  warning 
system  will  be  integrated.  The  development  will  be 
based  on  a  bilaterally  defined  threat  scenario  with 
the  potential  of  adaptation  to  national  requirements. 
The  detected  threat  information  will  be  evaluated 
by  the  RW/LW  computer  who  will  provide  con¬ 
densed  information  to  the  crew  (audio  and  visual). 
The  basic  system  contains  growth  capacity  for 
integration  of  defensive  countermeasures.  An  IFF 
transponder  is  also  part  of  the  basic  ECM  fit. 

-  COMMUNICATION:  The  tasks  related  to  commu¬ 
nication  within  the  HC  flight  or  with  external 
ground  stations  is  normally  quite  demanding  for 
the  crew.  For  PAH  2  new  radios  (VHF/UHF, 
VHF-FM  and  HF)  are  developed  to  ensure  integra¬ 
tion  into  communication  networks  of  the  future 
armed  forces  networks  -  this  includes  data  link 
functions  apart  from  normal  voice  communication. 
Control  of  the  radios  is  done  via  the  central 
display  and  '-ontrol  system  (mainly  CDUs).  Emer¬ 
gency  frequencies  are  also  accessible  from  a 
dedicated  "Radio  Frequency  Indicator". 

-  TACTICAL  SUBSYSTEM:  In  combination  with 
the  network  and  data  link  functions  of  the 


VHF-FM  and  HF  and  the  digital  map  generator 
the  PAH  2  has  capabilities  for  tactical  mission 
planning.  Tactical  data  may  be  loaded  on  ground, 
transmitted  via  data  link  or  inserted  manually  by 
the  crew  and  will  be  displayed  on  top  of  a 
geographical  raster  map.  With  these  capabilities 
the  HC  commander/gunner  is  provided  with 
accurate  and  timely  information. 

-  MISSION  EQUIPMENT  PACKAGE:  The  crew 
has  access  to  various  sighting  subsystems  for  fire 
control  and  piloting  and  to  various  armament  sub¬ 
systems.  Main  armament  are  the  HOT  and 
ATGW3  missiles.  For  self  defence  against  aerial 
threats  each  HC  may  be  fitted  with  up  to  4  A/A 
STINGER  missiles.  The  main  sight  for  target 
acquisition  and  firing  will  be  a  mast  mounted 
sight  developed  in  the  frame  of  the  ATGW3 
programme  (OSIRIS  with  TT,  TV  and  LRF).  Its 
image  may  be  displayed  on  MFDs  in  each  cock¬ 
pit  or  on  the  specific  HID  -  the  H  may  be  used 
as  backup  for  piloting  and  may  be  displayed  on 
the  crews  monocular  HMD.  For  piloting  the  main 
sensor  is  a  nose  mounted  n  (derived  from  the 
OSIRIS  TT).  Pointing  devices  for  both  brew  mem¬ 
bers  are  HMS  and  for  the  gunner  a  hand  control¬ 
ler/cursor. 

-  CONTROL  AND  DISPLAY  SUBSYSTEM:  This 
subsystem  performs  the  global  task  of  monitoring 
and  control  of  the  avionic  and  main  nonaviomc 
subsystems.  The  core  of  the  system  are  2  redun¬ 
dant  main  computers  (BCSGs),  2  data  acquisition 
units  (RTUs)  and  2  redundant  mission  computers 
(MCSG).  The  main  interface  to  the  crew  are  2 
CDUs  and  4  MFDs.  The  SG  functions  for  the 
MFDs  is  integrated  in  the  BCSGs,  for  HMDs  in 
the  MCSGs.  The  RTUs  acquire  the  data  of  most 
nonavionic  subsystems  (electric,  engine,  hydraulic 
subsystem,  etc.)  and  provide  them  for  failures  or 
exceedances  and  display  (on  crew  request  or  in 
case  of  detected  anomalies).  The  MCSGs  are 
monitoring  and  controlling  the  mission  subsystems 
and  provide  to  the  BCSGs  the  essential  informa¬ 
tion  for  control  and  display.  The  BCSGs  are 
monitoring  the  complete  system  -  using  the  data 
provided  by  the  individual  subsystems  (including 
RTUs  and  MCSGs)  and  generate  the  interface  to 
the  crew  -  the  crew  interacts  with  the  system 
mainly  via  CDUs  and  the  keyboards  on  the 
MFDs.  Detected  failures  will  be  indicated  to  the 
crew  but  will  also  be  recorded  for  post  flight 
evaluation  by  the  maintenance  crew.  Pre  and  post 
flight  checks  are  supported  by  CDU  menus  to 
detect  and  locate  failures  beyond  the  capabilities 
of  the  failure  monitoring  during  normal  system 
operatioa  Thus,  the  crew  has  access  to  all  essen¬ 
tial  HC,  navigation  and  tactical  information  and 
is  not  loaded  with  several  routine  tasks  (as  system 
monitoring).  This  is  the  basis  to  get  rid  off  a 
variety  of  cockpit  instruments  in  favour  of  the  2 
MFDs  and  1  CDU  per  crew  station.  Some  in¬ 
struments  however  remain  for  first  engine  startup, 
emergency  purpose  and  to  ensure  higher  integrity 
and  availability  of  the  system. 
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3.  TARGETING  SENSOR  INTEGRATION 

Tactical  night  deployment  scenarios  assume  that  an 
antitank  helicopter  will  operate  in  an  area  dominated 
by  obstacles.  Flight  profiles  below  30  feet  are 
preferred,  such  as  NOE  and  extreme  contour  flight. 
Therefore,  the  precise  determination  of  locations  and 
obstacles  is  required  to  ensure  crew  safety  and 
mission  success.  In  the  PAH  2  development  phase 
a  high  performance  armament  and  visionic  system 
called  EUROMEP,  based  on  results  of  the  ATGW 
3  programme,  will  be  established. 

3.1  Night  Flight  Capability 

As  a  prerequisite  to  night  fighting,  night  flying 
capabilities  are  required.  Nignt  flight  requires  a  level 
of  concentration  on  the  part  of  the  pilot  which 
exceeds  the  norm,  especially  when  the  operation 
requires  a  mission  to  be  flown  below  30  feet.  The 
visual  tasks  of  the  pilot/copilot,  as  well  as  control 
activities,  increase  dramatically  the  closer  the  air¬ 
craft  flies  to  the  surface.  Thus  the  wide  range  of 
night  flight  tasks  must  be  divided  between  the  two 
crew  member  of  this  tandem  cockpit  helicopter. 

Starting  with  either  conventional  NVGs  or  piloting 
TI  systems  as  night  flying  aids  it  was  soon  recogni¬ 
zed  (sometimes  the  hard  way  through  crashes)  that 
physics  and  ergonomy  require  information  in  more 
than  one  spectral  range,  in  an  interpretable  manner 
in  front  of  both  eyes. 

The  pilot  visionic  system  (PVS)  being  part  of  the 
EUROMEP  system  provides  a  wide-field  of  view 
(30  x  40  deg)  IR  piloting  sight  which  consists  of  a 
thermal  imager  (TI)  installed  on  a  swivelling 
platform  located  in  the  TIGER  nose.  In  addition, 
each  crew  member  has  a  helmet-mounted  sight 
and  display  (HMS/D),  which  orients  the  sensor 
according  to  the  line  of  pilot  or  copilot  sight.  The 
PVS  is  used  not  only  for  the  piloting  function  but 
also  for  air-to-air  missile  firing. 

At  present,  studies  for  an  Integrated  Helmet 
System  (IHS)  are  performed  to  provide  the  capabili¬ 
ty  of  binocular/biocular  vision  and  a  second 
sensor  based  on  image  intensification  tube  (IIT) 
technology.  Another  possible  solution  is  the  inte¬ 
gration  of  a  Low  Light  Level  TV  camera 
(LLLTV)  together  with  the  TI  on  the  PSU.  As  a 
further  improvement,  a  combination  of  features 
extracted  from  the  thermal  image  and  the  (realistic) 
LLLTV  image  may  be  considered. 

MBB/DASA  and  the  German  Army  Aviation  Corps 
have  performed  ground  and  flight  trails  with  an  IHS 
and  a  HMS  on  a  PAH  1  respectively  a  BK  117 
helicopter.  In  parallel  investigations  in  our  visionic 
laboratory  have  been  performed  with  a  GEC  and 
Honeywell  IHS. 

3.2  Day  and  Night  Combat  Capability 

As  main  sensor  for  ground  targets  within  the 


EUROMEP  system  a  GVI  (gunner  visionic)  system 
with  an  MMS  (mast-mounted  sight)  is  chosen 

o  to  reduce  the  exposure  time  during  target  acquisi¬ 
tion  combat  phase 

o  to  have  a  periscopic  view  from  behind  protective 
cover,  with  an  overall  view  of  nearly  360  degree 
in  azimuth 

o  to  reduce  the  visible,  IR  and  also  radar 
cross-section  of  the  HC  behind  cover  and  thus  to 
reduce  the  vulnerability 
o  to  tptimize  the  CG  of  the  HC  and 
o  to  minimize  the  disturbance  of  sight  windows 
fro  In  the  exhaust  missile  gas. 

The  GVI  consists  of  the  following  components 

-  Two-stage  stabilized  mast-mounted  sight  (MMS) 
platform 

oa  high  performance  Thermal  Imager  (TI)  with 
three  optical  FOVs  and  additionally  three  FOVs 
with  underscanning  using  the  IRCCD  technology 
oa  high  resolution  TV  camera  with  three  FOVs 
oa  Laser  Range  Finder  (LRF)  in  10  m  range 
working  together  with  the  n 
O  an  Electro  Optical  Block  (EOB)  for  locating  the 
HOT  missile 

-  Fire  Control  Computer/Display  Processor  and 
Alignment  Processor 

-  Sight  Electronic 

-  Target  Tracker,  tracking  up  to  four  targets 

-  Head-In  Display  (HID)  for  the  missile  guidance 
process 

-  Multifunction  Displays  (MFD)  in  the  cockpit 

Concerning  the  antitank  armament,  wire  guided 
HOT  missiles  and  fire  and  forget  ATGW  3  LR 
missiles  may  be  used. 

The  sight  enables  the  gunner  in  association  with  the 
connected  display  to  acquire  and  engage  tanks  at  the 
distance  of  approx.  5000  m  during  day  and  night 
time  using  the  different  sensor  FOVs.  The  image 
generated  from  the  gunner  sight  sensors  serve  three 
purposes: 

-  observation  by  the  gunner  or  in  emergency  case 
the  pilot  (FOV  =  30  deg  x  40  deg) 

-  manuell  HOT  or  ATGW  3  LR  engagement  by 
the  gunner 

-  automatic  image  processing  for  tracking  and 
ATGW  3  seeker  alignment. 

The  gunner  can  choose  the  sensor  for  observation 
depending  on  illumination  and  weather  condition. 
For  automatic  image  processing  the  signals  of  the 
TI  or  of  the  TV -camera  will  be  used.  The  main 
optical  sensor  is  for  the  day  and  night  time  ap¬ 
plication  and  for  the  ATGW  3  engagement  the  TI 
sensor.  For  ATGW  3  seeker  alignment/lock  on,  a 
correlation  of  missile  seeker  image  and  MMS  sensor 
image  are  performed. 

The  gunner  can  designate  targets  for  automatic 
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tracking  white  he  is  observing  either  a  'll  or  a  TV 
image.  Any  changing  of  FOV  with  the  same  magni¬ 
fication  will  be  done  simultaneously  for  these 
sensors.  Indication  of  the  LOS  direction  and  the 
status  of  the  sight  will  be  displayed  as  symbols  on 
the  monitor.  The  digital  sight  information  would 
lend  itself  readily  for  automatic  feature  analysis 
using  image  processing  algorithms.  Presently,  such 
a  feature  is  not  available  within  the  ATGW  3  pro¬ 
gramme  for  HC  applications.  After  availability  it 
could  easily  integrated  into  the  system  thus  reducing 
the  gunner’s  woikload  further. 

3.3  Avionic  System  Integration 

The  integration  of  the  PAH  2  subsystems  as  des¬ 
cribed  above  is  the  basis  for  the  functional  integra¬ 
tion  on  both  the  avionic  system  level  and  the 
operations  level. 

This  section  shall  highlight  some  features  of  the 
weapon  system  achieved  by  functional  integration  of 
the  Tactical  Subsystem  and  the  EUROMEP. 

The  following  subsystem  functions  are  involved  in 
the  examples: 

-  the  Digital  Map  Generator  (DMG)  providing  a 
map  with  overlays  of  tactical  information, 

-  the  Video  Memory  storing  MMS  sensor  images, 
which  can  be  evaluated  in  concealment, 

-  the  Mission  Data  Transfer  System  (MDTS)  and 
the  Data  Insertion  Device  (DID)  for  uploading  and 
downloading  of  tactical  data, 

-  the  Data  Link  for  updating  the  HC’s  internal 
database  and  for  transmission  of  tactical  informa¬ 
tion  to  other  HCs  or  ground  troops, 

-  the  Mast  Mounted  Sight  (MMS)  as  the  main 
sensor  for  target  acquisition. 

3.3.1  Predirection  of  the  MMS 

The  MMS  can  be  predirected  to  targets,  which  have 
been  marked  on  the  Digital  Map  or  using  an  image 
of  the  Video  Memory.  This  feature  allows  for  a 
NOE  flight  to  the  attack  position  and  for  fast  target 
acquisition  and  firing. 

The  target  on  the  Digital  Map  may  have  been 
uploaded  from  a  database  or  may  have  been  entered 
using  the  method  as  described  in  the  next  section. 

3.3.2  Passive  Target  Ranging 

The  parallel  use  of  the  imagery  provided  by  the 
MMS  and  of  target  information  displayed  on  the 
DMG  allows  for  an  improvement  of  target  ranging 
by  comparing  information  from  stadiametric  ranging 
with  map  information.  The  imagery  of  the  MMS  is 
displayed  on  one  MFD  while  the  map  overlayed 
with  the  LOS  of  the  MMS  is  displayed  on  the  other 
MFD. 

If  the  taiget  is  not  moving,  the  accuracy  can  even 
be  enhanced  by  acquiring  target  information  from 
different  HC  positions.  The  target  position  is  the 


crossover  of  two  LOS  layed  over  the  digital  map 
image. 

The  Video  Memory  stores  up  to  eight  images  of 
one  of  the  sensors  allowing  for  an  acquisition  and 
evaluation  of  a  large  part  of  the  scene  in  conceal¬ 
ment.  All  objects  identified  may  be  used  as  targets 
for  immediate  MMS  predirection,  target  acquisition 
and  firing. 

3.3.3  Maintaining  the  HC  Tactical  Database 

This  feature  forms  part  of  the  integration  at  opera¬ 
tions  level.  The  database  of  an  individual  HC  is 
uploaded  from  MDTS  and  DID  and  presented  as 
synthetical  overlay  on  the  Digital  Map. 

The  information  is  updated  during  the  flight  to  the 
forward  position  using  the  Data  Link.  This  update 
occurs  in  a  hierarchical  manner  the  leader  of  the 
flight  is  informed  first  and  provides  the  information 
to  the  other  HCs  of  his  flight.  The  flight  leader  may 
transmit  a  subset  of  the  information  only. 

This  proceeding  ensures  a  database  as  common  as 
possible  for  all  HCs  of  a  flight. 

The  database  may  be  updated  using  information 
acquired  by  the  HC’s  systems  or  manually  using 
information  gained  from  combat  troops. 

Target  informations  may  be  handed  over  via  Data 
Link  from  other  HCs  of  the  flight  in  order  to 
coordinate  attacks. 

3.3.4  Maintaining  the  Operation  Center  Tactical 
Database 

The  database  of  the  HC  provides  the  latest  availa¬ 
ble  tactical  information. 

This  information  may  be  transmitted  to  the  opera¬ 
tions  center  via  Data  Link.  In  addition,  the  HC’s 
database  can  be  downloaded  to  the  MDTS  and  read 
out  at  the  basis. 

ejsfiugsioH 

DISCUSSOR:  Hr  M.  JACOBSEN  (Germany) 

(NU) .  Can  you  comment  on  how  passive 
Target  Ranging  is  accomplished  ? 

R?PIJf 

>-n  the  first  display,  the 
perspective  view  as  seen  by  the 
Gunner  Sight  is  displayed.  A  Target, 
which  may  be  positioned  e.g.  on  a 
road,  is  marked.  The  distance  is 
roughly  measured  using  stadiametric 
Ranging. 

On  the  second  display,  the  Digital 
Map  is  shown.-  Once  the  target  is 
marked,  the  LOS  (present  position  to 
Target)  is  displayed..  Because  of  the 
unaccuracy  of  the  Stadiametric 
Ranging,  the  target  mark  will  not  be 
positioned  on  the  intersection  of 
the  LOS  and  the  touch,,  but  some 
where  else  on  the  LOS. 

The  correct  distance  information  is 
gained  by  adjusting  the  position  of 
the  Target  along  the  line  of  sight 
until  it  is  located  on  the 
intersection  of  LOS. 
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Summary 

The  integration  of  the  CL-227  LAV  Sea 
Sentinel  System  with  the  Canadian  Patrol 
Frigate  (CPF)  platform  provides  the  naval 
target  classification  and  designation 
capability  meeting  the  mission 
requirements  of  this  and  following  decade. 

The  present  capability  with  manned  aircraft 
is  significantly  enhanced  including  growth 
potential  to  match  the  continuing 
development  of  stand-off  Anti-Surface  Ship 
Missiles  (ASSM)  and  the  increased  likelihood 
of  coastal  patrol  mission  requirements.  The 
LAV  System  complements  the  manned 
aircraft  in  the  areas  of  high  air  defence 
risk,  poor  weather,  peak  overloads,  and 
routine  tasks. 

The  low  signature  air  vehicle  permits 
covert,  highly  survivable  missions.  The 
modular  mission  payload  capacity  provides 
for  a  mix  of  single  or  combined  high 
performance  payloads  with  a  high  time  on 
station. 

Transmitting  real-time  high  resolution 
imagery  from  the  LAV  to  the  ship  from  long 
ranges  places  significant  demands  on  the 
payload  data  downlink.  The  selection  of 

such  a  link  must  consider  the  present 
installed  link  capability,  as  well  as 
interoperability  requirements  with  other 
NATO  ships. 

The  functions  of  mission  planning,  ai>' 
vehicle  and  payload  control,  and  data 
exploitation  of  the  LAV  System  including 
data  fusion,  must  be  integrated  into  the  ship 
platform.  The  architecture  and  capability 
of  the  Canadian  Ship's  Integrated 
Processing  and  Display  System  (SHINPADS) 
and  the  future  NSA  Shipboard  Tactical 
Support  System  (STSS)  of  the  CPF  Combat 
System  facilitate  integration. 

A  Maritime  LAV  system  designed  to  exploit 
the  CL-27  Sea  Sentinel  and  the  CPF  SHINPADS 
combat  system  offers  an  effective  option  for 
enhancing  CPF  with  the  ability  to  perform 
Over  the  Horizon  (OTH)  natal  target 
classification  and  designation. 

1.  Introduction 

Stand-Off  Anti  Surface-Ship  Missile  (ASSM) 
ranges  far  exceed  surface  ship  surveillance 
and  fire-control  sensoi  system  horizons. 
Naval  Gunfire  Support  requires  a  remote 
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(from  the  ship)  observer's  perspective,  for 
accurate  fall-of-shot  correction.  The  Rules  of 
Engagement  in  times  of  hostilities  may 
require  confident  classification  of  target 
nationality,  capability  and  intentions,  before 
shots  are  fired.  These  facts  pose  tactical 
problems  to  both  the  offensive  and  defensive 
mission  performance  of  every  surface 
warship. 

One  classical  solution  to  these  problems  has 
been  lo  provide  the  ship's  command  with  ihe 
support  of  one  or  more  aerial  observer 
Traditionally,  these  observers  have  been 
human  occupants  of  manned  lighter-lhan-air, 
fixed-wing  or  rotary-wing  aircraft.  Some 
such  aircraft  are  capable  of  conducting  part  or 
all  of  the  engagement,  themselves.  Others 
provide  Over-The-Horizon  (OTH)  surveillance, 
detection,  tracking  and/or  designation 
support  to  the  engaging  surface  force(s). 

Surveillance,  detection  and  tracking  are  the 
ship's  functions  which  most  require  horizon 
extension.  Most  classes  of  warship  which  are 
fitted  with  ASSMs,  however,  are  not  capable 
of  carrying  manned  fixed-wing  aircraft 
Lighter-than-air  manned  aircraft  are  not 
commonly  available  .  support  of  modern 
navies,  and  rotary-wing  manned  aircraft  are 
often  too  vulnerable  to  surface-to-air  missile 
attack  to  be  able  lo  serve  in  the  required  OTH 
mission  roles,  without  incurring  high  risks 

The  capability  to  carry  out  this  role  is 
necessary  in  a  variety  of  scenarios.  For 
Canada  a  common  scenario  is  that  of  peace 
keeping.  Others  include  neutral  operations  in 
the  neighbourhood  of  hostilities  and  non¬ 
neutral  operations  prior  to  and  during 
hostilities.  Support  to  civilian  operations  such 
as  anti-drug  opeiations  and  fishery 
operations  must  also  be  considered. 

Recent  wartime  experience  has  confirmed  the 
substantial  practical  value  of  Unmanned  Air 
Vehicle  (UAV)  support  for  precisely  these 
high-risk  mission  support  roles  UAVs  have 
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been  demonstrated  to  provide  Target 
Detection,  Target  Classification,  Fall-of-Shot 
Observation  and  Battle-Damage-Assessment 
support  to  surface  warships,  in  active  combat 
Experience  has  shown  that  VTOL  UAV 
systems  should  be  used. 

The  capability  to  carry  out  the  key  role 
covertly  is  an  important  advantage  of  the  CL- 
227  Sea  Sentinel  UAV  System  due  to  its  low 
signature  air  vehicles.  A  further  advantage  is 
the  capability  to  carry  alternative  or  multiple 
payloads  suitable  for  the  role  of  over-the- 
horizon  target  acquisition,  classification  and 
designation  with  an  appropriate  endurance. 
The  system  also  imposes  minimal  demands  on 
the  ship  platform  infrastructure.  Sea 
Sentinel's  Vertical  Take-Off  and  Landing 
(VTOL)  capability  clearly  makes  her  an 
attractive  choice  for  retrofitting  onto  a  wide 
range  of  ship  classes.  As  a  Standard  Maritime 
UAV,  Sea  Sentinel  has  demonstrated  VTOL 
operations  off  the  deck  of  ships  to  both  NATO 
and  US  forces.  In  the  JANTIDE  and  most 
recently  in  the  MAVUS  programs,  the 
Canadair  Sea  Sentinel  has  demonstrated 
providing  OTH  support  to  surface  ships. 

In  this  paper,  some  of  the  issues  and  benefits 
associated  with  retrofitting  such  a  Maritime 
UAV  system  into  a  helicopter-carrying  frigate 
are  reviewed. 

The  frigate  discussed  is  the  City  Class 
Canadian  Patrol  Frigate  (CPF)  The  CL-227 
Maritime  UAV  System  discussed  is  comprised 
of. 

1  Air  vehicles; 

2.  Modular  Mission  Payloads; 

3.  Launch  and  recovery  subsystem; 

4.  A  ship-to-UAV  data  uplink  function, 

5.  A  UAV-to-ship  data  downlink  function. 

a.  Status  monitoring  downlink 

b.  Payload  data  downlink, 

6.  Mission  Planning/Control  Functions- 

a.  Mission  planning; 

b.  Air  Vehicle  Control; 

c.  Payload  Control; 

d  Data  Exploitation 

The  CL-227  is  discussed  in  section  2  Section 
3  presents  a  high-level  overview  of  the  CPF,, 
and  of  its  combat  missions. 

A  discussion  of  the  launch  and  recovery 
subsystem  is  beyond  the  scope  of  this  paper, 
but  there  ts  mention  of  the  impact  of  the 
recovery  phase  requirements  on  the  ship-to- 
UAV  uplink  design  decisions. 

Section  4  proposes  alternative  strategies  by 


which  a  UAV  System  might  be  implemented, 
on  a  CPF,  with  a  perspective  on  the  relative 
merits  and  problems  of  each  approach 

The  paper  concludes  that  a  Maritime  UAV 
system  designed  to  exploit  the  CL-227  Sea 
Sentinel  and  the  CPF  SHINPADS  Combat 
System  offers  an  effective  option  for 
enhancing  CPF  with  the  ability  to  perform 
Over  the  Horizon  (OTH)  naval  target 
classification  and  designation. 

2.  The  CL-227  Sea-Sentinel 

2.1  Development  History 

The  CL-227  UAV  system  was  originally 
conceived  as  a  close-range  battlefield 
surveillance  and  target  acquisition  system.  A 
Maritime  version  of  the  CL-227  has  also  been 
developed,  to  support  short  range  naval 
operations.  The  development  of  the  land  and 
maritime  configurations  has  continued  in 
parallel,  with  a  high  degree  of  commonality 
and  synergy.  Figure  1  shows  the  CL-227  air 
vehicle  concept. 


Proof  of  concept  flights  were  carried  out  in 
the  period  1977-1780  In  1981-1982,  flights 
demonstrated  a  representative  system  using  a 
stabilized  vidicon  camera  and  commercial 
microwave  command  and  data  link 
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In  1989  Canadair  started  development  of  a 
militarized  prototype  system.  A  joint 
US/Canadtan  evaluation  was  conducted  in 
1989  and  1990  to  evaluate  the  system  for 
Army,  Navy  and  Air  Force  missions. 

Over  500  CL-227  flights  have  been 

successfully  conducted  in  either  a  tethered  or 
free-flight  mode. 

2.2  Sea  Sentinel  Development  Status 

From  1986  to  1989,  the  team  of  Canadair, 
Indal  Technologies  and  Paramax  Electronics 
Inc  carried  out  design  studies  for  the  USN  and 
DND  on  a  sea  variant  of  the  CL-227  Sentinel 
System.  Systems  engineering  studies  were 
carried  out  to  define  a  launch  and  recovery 
system  (Ref.  1,2)  including  a  simulation  model 
to  establish  landing  accuracy.  Ship  motion 
and  sea  condition  data  were  based  on  the 
methodology  developed  in  work  for  DND  and 
USN  NATC  (Rtf.3) 

The  Maritime  Electronic  Warfare  Payload 
Development  System  (MEWPADS)  study, 
commissioned  by  the  DND  Directorate  of 
Maritime  Combat  Systems  (DMCS),  established 
the  feasibility  of  a  CL-227  Sentinel  System 
operating  from  a  ship  in  an  EW  role.  The 
study  identified  lilable  NDI  ESM  and  ECM 
sensors  and  c  ,  'ated  the  enhancement  of 
the  ship's  EV\  <  ip.  Iity  (Ref.4).  In  particular 
uii  analysis  v/.-s  ,.  Tried  out  on  targeting 
mission  performa  .  c  using  an  FSM  payload. 

Based  on  the  studies,  in  1989  a  demonstration 
Sea  Sentinel  System  was  developed  and  a 
dual  demonstration  carried  ou'.  Take-off  and 
landing  from  the  US  Army  ship  JANTIDE  was 
demon  .(rated  to  NATO  Special  Working  Group 
(SWG)  II.  A  surface  ship  OTH  support 
mission  demonstration  was  carried  out  in 
conjunction  with  the  PEO-IEW  Small  Aerostat 
Surveillance  System  (jaSS),  operating  off  the 
JANTIDE  (Figur<-  2  shows  a  landing  on  the 
JANTIDE).  SASS  comprises  an  radar  payload 
carried  by  a  airship  tethered  to  a  ship  with 
the  monitor  The  exercise  used  the  SASS 
rada.  to  search  a  wide  area  and  to  cue,  in  real 
time,  locations  of  suspect  targets  for  the  CL- 
227  to  classify. 

The  JANTIDE  exercise  (Ref  5)  shewed. 

i.  viability  of  vectoring  a  UAV  to  a  surface 
target,  using  radar  contact  data 

ii.  real  time  visual  classification  data  relayed 
from  a  UAV  imaging  payload,  in  support  of 
radar  operations; 

in  operational  compatibility  of  the  CL-227 
system  with  an  aerostat  system, 
iv  viability  of  VTOL  UAV  launch  and  recovery, 
at  sea 


Figure  2  CL-227  UAV  Landing  on  Ship 


In  1990,  the  US  DoD  UAV  Joint  Project  Office 
(JPO)  awarded  a  contract  to  Canadair  to 
integrate  and  adapt  the  proven  CL-227 
hardware  wi*1'  .he  Loral  mission  planning 
vo>.:;ui  s >:'«  .  and  data  link  equipment  to 
maritime  requirements.  The  contract  includes 
an  at-sea  operational  demonstration  of  VTOL 
UAV  operations  in  support  of  a  US  naval  ship 
in  a  NATO  exercise.  This  Maritime  VTOL  UAV 
System  (MAVUS)  operational  demonstration 
is  scheduled  to  end  in  December  1991. 

The  multi-national  NATO  Project  Group  (PG)- 
35  Maritime  Operational  Demonstration 
includes  American,  Canadian,  British  and 
Dutch  participation. 

exercises  like  JaNTIDE  and  MAVUS  confirm 
the  viability  of  VTOL  UAV  mission  roles  and 
tactics  in  support  of  maritime  forces. 

2,3  CL-227  Improvement  Program 

The  continuing  evolution  of  NATO's  Maritime 
UAV  System  requirements  (through  SWG- 11 
and  PG-35)  is  establishing  modular  mission 
payload,  data  link,  mission  endurance  and 
mission  employment  requirements. 

Canadair  is  reviewing  these  requirements  and 
investigating  prodi.c..  improvements  to 
maintain  the  CL-227's  optimum  response  to 
requirements 

Potential  improvements  to  the  baseline 
MAVUS  CL-227  system  include: 

-  a  highet  gross  take-off  mass  with  larger 
rotors 

-  an  improved  slightly  larger  airframe 
made  of  composite  materials 
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-  a  higher  power  engine  (such  as  the 
Williams  WTS-117); 

-  a  larger  composite  fuel  tank; 

-  GPS  for  autonomous  navigation  ; 

-  ESM,  Synthetic  Aperture  Radar,  and  mine 
detection  payloads,  in  addition  to 
MAVUS  (FOR,  TV,  communications  relay 
and  ECM)  payloads; 

•  Snip  Combat  System  integration  concepts, 
to  make  maximum  use  of  existing 
antennas,  processors  and  ship  consoles. 

Upscaling  the  air  vehicle  has  historically 
proven  to  be  a  negligible-risk  project. 
Tables  1  and  2  present  the  performance  data, 
and  mass,  respectively,  for  two  configurations. 
One  configuration  provides  a  near-term 
capability  and  the  other  long  term. 


NEAR 

TERM 

LONG  TERM 

WITH 

SINCLl 

MISSION 

PAYLOAD 

WITH 

MULTIPLE 

MISSION 

PAYLOADS 

MISSION  RANGE 
<NM) 

70 

100 

100 

T'ME  ON  STATION 
(HRS) 

06 

>20 

>10 

TOTAL  MISSION  TIME 
(HRS) 

>30 

>40 

>40 

MAXIMUM  Mil  SION 
RANCE 
(NM) 

>85 

>  100 

>  100 

MAXIMUM  ENDURANCE 
(HRS) 

>3  25 

>50 

>50 

LOITER  AIRSPEED 
(KTS) 

39 

50 

50 

CRUISE  AIRSPEED 
(KTS) 

60 

80 

80 

MAXIMUM  AIRSPEED 
(KTS) 

70 

>  100 

>  100 

TAHLE  1  PR  bDICTFD  PERFORMANCE 


Notes: 

1.  Mission  range  shown  is  typical; 
maximum  is  greater  than  lOOn.m. 

2.  Mission  time  is  maximum  endurance;  15 
min.  reserve  excluded. 

3  Modular  mission  payload  is  mission 
specific  part  of  payload  module. 

4.  Payload  mass  shown  are  for  FLIR,  FLIR 
with  supplementary  tank  and  multiple 
payload  respectively. 


NEAR 

TERM 


WITH 

SINGLE 

MISSION 

PAYLOAD 


WITH 

MULTIPLE 

MISSION 

PAYLOADS 


MODULAR  PAYLOAD 
WEIGHT 
(KG) 


23 


23 


45 


MAXIMUM  TAKEOFF 
WEIGHT 
(KO) 


215 


350 


350 


TABLE  2  MASS 


The  proposed  improvements  result  in  a 
mission  payload  of  23  to  40  Kg.  Depending 
upon  the  mission  requirements,  the  CL-227 
Sea  Sentinel  can  be  capable  of  carrying 
multiple  sensor  payloads  on  the  same  mission, 
or  a  single  payload  and  an  auxiliary  fuel  tank. 
Figure  3  illustrates  several  modular  mission 
payload  options. 


MAVUS 
TV  CAMERA* 
Canon  C1-20M 


MAVUS 

FLIR* 

Kollmorgen 


MAVUS  ECM* 
Dalmo  Victor 
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Figure  3  Modular  Mission  Payload  Opuons 
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3.  The  Canadian  Patrol  Frigate  (CPF) 

3.1  General 

The  CPF  is  Canada's  newest  warship,  and  one 
of  the  most  advanced  frigates  in  NATO,  today. 

3.2  The  Missions 

3.2.1  The  Primary  Mission 

The  primary  mission  of  CPF  is  Anti- 
Submarine  Warfare  (ASW). 

Fitted  with  both  active  and  passive  ASW 
sensors,  onboard  torpedoes  and  an  ASW 
helicopter,  CPF  is  capable  of  performing  in 
both  inner  and  outer  ASW  screens. 

The  primary  ASW  mission  requirements  are 

1 .  Search,  Detect,  Classify  and  Track  all 
potentially  hostile  acoustic  targets; 

2.  Report  all  acoustic  targets  to  the  Tactical 
Fotce  Command, 

3.  Prosecute  designated  hostile  targets 

3.2.2  The  Secondary  Missions 

CPF  is  also  capable  of  performing  both  air  and 
surface  warfare  missions. 

CPF  surveys  the  above-water  horizon,  with 

both  long  and  medium  range  area 

surveillance  radars,  a  Close-in-Weapon 

system  surveillance  radar,  a  broadband  RF 
intercept/DF  system,  and  an  Electronic 

Support  Measures  (ESM)  system. 

CPF  is  capable  of  engaging  hostile  air  targets 
with  coordinated  combination  of;  Electronic 
Countermeasures  (Onboard  and  Offboard); 
Vertical  Launch  Sea  Sparrows,  the  57mm 
Rapid  Fire  gun,  and  the  CIWS  galling  gun. 

CPF  is  capable  of  engaging  hostile  surface 
targets  with  the  HARPOON  ASSM,  the  57mm 
gun  and  the  CIWS  gatling  gun. 

Although  CPF  may  be  tasked  to  perform  any 
one  of  these  missions  to  the  exclusion  of  all 
others,  CPF  is  specifically  designed  to  be 
capable  of  engaging  in  all  three  warfare 
missions,  simultaneously. 


3.3  The  CPF  Combat  System 

The  Canadian  Patrol  Frigate  Combat  System  is 
an  implementation  of  the  Canadian  Ship's 
Integrated  Processing  and  Display  System 
(SHINADS)  concept 


Unisys  Corp  AN/UYK-507  militarized  general 
purpose  processors  are  distributed 
throughout  the  ship,  integrated  via  a 
redundant  high-speed  (lOMb/s)  serial 
databus  and  the  SDX  distributed  operating 
system. 

The  Combat  Operations  Room  personnel 
manage  the  Combat  System  via  Standard 
SHINPADS  Display  consoles,  any  one  of  which 
can  be  programmed  to  function  in  any 
available  console  mode.  Each  operator's  tasks 
and  responsibilities  has  been  identified  and 
grouped  into  a  hierarchical  menu  of  soft-key 
arrays.  An  operator  selects  the  appropriate 
set  of  menus,  by  selecting  the  appropriate 
console  “mode". 

To  the  extent  that  an  operator's  duties  can  be 
adequately  performed  without  interacting 
w'th  dedicated  system  hardware,,  an  operator 
uan  .form  his  tasks  at  any  Standard 
Displ  i. 

The  Hull  Mounted  Sonar,  Sonobuoy  Processing 
System  and  Fire  Control  System  generate  kS- 
343  video,  selectable  at  any  SHINPADS 
Standard  Display  consoles.  The  Video 
Distribution  system  is  capable  of  routing 
either  RS-343  or  RS-170  video  signals 


The  CPF  SHINPADS  system  has  an  open 
architecture  Adding  new  subsystems  is 
achievable  by  one  of  the  following  strategies: 

1 .  Subsystems  which  can  be  implemented  as 
software  on  an  AN/UYK-507,.  running 
under  SDX,  can  be  integrated  directly  into 
the  existing  combat  system  (subject  to 
practical  issues  such  as  system  resource 
requirements), 

2.  Subsystems  which  meet  the  first  criteria, 

but  exceed  the  available  spare  system 
resources,,  may  be  implemented  by 
adding  a  new  AN/UYK-507  which  can  still 
be  interfaced  to  an  existing  or  new 

processor  to  the  bus, 

3.  Subsystems  which  cannot  be 

implemented  in  an  AN/UYK-507  can  still 
be  interfaced  to  an  existing  or  new 

processor,  via  any  of  the  following 
interface  types: 

a.  NATO  Serial; 

b,  Mil-Std- 1 397  (NTDS)  Parallel; 
c  RS-232C;  or 

d  Mil-Std- 1 88C. 
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Sensor  video  provided  by  a  new  system  can 
be  routed  to  the  existing  Standard  Displays, 
by  adding  new  input  channels  to  the  existing 
Video  Distribution  System,  if  the  video 
complies  with  either  RS-343  or  RS-170 
standards. 


The  CPF  SHINPADS  databus  is  loaded  to  less 
than  10%  of  capacity.  A  minimum  of  20% 
future  growth  capacity  has  been  reserved  in 
the  system  memory  resources. 

4.  Employing  a  Maritime  UAV  System 
in  Support  of  CPF 

4.1  CPF  ASuW  Missions  Which  a  UAV 
System  Might  Support 

4.1.1  General 

The  CPF  is  already  effective  in  its  planned 
ASuW  missions,  without  a  UAV  System.  In 
situations  where  airborne  support  is  required, 
CPF  deploys  the  helicopter,  or  vectors 
assigned  supporting  aircraft. 

The  authors  of  this  paper  propose  that  the 
integration  of  a  Maritime  UAV  System  would 
further  augment  the  CPF's  overall  mission 
effectiveness 

Rather  than  proposing  to  replace  the  aircraft 
in  these  missions,  we  evaluate  the  manner  in 
which  UAVs  might  enhance  the  safety  and 
effectiveness  of  current  CPF/helo  mission 
performance 

In  this  section,,  the  mission  phases 
characteristic  of  the  missions  discussed  are 
identified.  In  section  4.2,  the  exploitation  of 
various  UAV  payload  types  are  explored  in 
terms  of  the  requirements  of  each  mission 
phase. 


4.1.2  Supporting  Long-Range  SurfaceShip 
Engagements 

The  primary  ASW  sensor  of  the  CPF  is  a 
Tactical  Towed-Arrayed  Sonar  (TACTAS) 
TACTAS  is  not,  however,  exclusively  useful 
for  ASW. 

TACTAS  also  provides  CPF  with  the  invaluable 
capability  to  passively  detect  and  classify 
surface  shipping  which  is  over  the  (above¬ 
water  surveillance)  horizon 

CPF  can  process  the  TACTAS  data  through  a 
variety  of  Target  Motion  Analysis  (TMA) 
functions,  to  track  and  localize  those  contacts. 


The  effective  range  of  TACTAS  is  such  that 
slow-moving  surface  targets  at  maximum 
sensor  range  would  take  hours  to  localize  well 
enough  for  a  HARPOON  fire  control  solution. 
It  would  require  less  than  half  an  hour, 
however,  to  localize  such  a  target  adequately 
well  to  provide  an  Area  of  Probability  small 
enough  to  effectively  survey  with  a  UAV. 

CPF  presently  employs  its  helicopter  and/or 
third  party  aircraft,  to  investigate  and 
prosecute  their  TACTAS  contacts.  A  Maritime 
UAV  system  offers  an  alternative  to  exposing 
manned  aircraft  to  the  risk  of  hostile 
responses  from  the  targets  they  investigate. 

When  the  target  is  beyond  CPF's  radar 
systems  horizon,  likely  mission  phases  are: 

1 .  Surveillance:  monitoring  passive  sensors,, 
including  TACTAS,  DF,  and  ESM; 

2.  Detection:  detecting  possible  targets, 
on  one  or  more  passive  sensors; 

3.  Classification:  estimating  probable  target 
type,  capabilities  and  intentions,  on  the 
basis  of  detected  signatures, 

4.  Localization:  estimating  probable  target 
position,  and  possibly  direction,  range, 
course  and/or  speed,  with  uncertainties; 

5.  Tracking,  refining  the  estimated  position, 
course  and  speed  data,  and  establishing 
an  estimated  state  vector  for  the  target, 
and 

6.  Engagement:  planning  and  executing  an 
attack  against  the  target,  conducting 
battle  damage  assessment,  and 
responding,  as  appropriate,  with  self- 
defenses  and/or  additional  hostilities 

Throughout  the  mission,;  voice  and  tactical 
data  link  communications  are  also  probable, 
between  CPF,  supporting  aircraft,  and/or 
other  cooperating  forces. 


4.1.3  Supporting  Coastal  Patrol  Missions 

Coastal  patrol  mission  present  a  number  of 
unique  problems. 

Land  clutter  and  shallow-water  conditions 
compromise  the  ship's  sensor  systems, 
presenting  solid  barriers  at  relatively  short 
distances  (compared  with  open-ocean  line  of 
sight  horizons). 

In  populated  area.,  local  telecommunication 
and  radar  activities  tend  to  clutter  the 
electromagnetic  spectrum,  which  tends  to 
hamper  the  use  of  ESM.  In  hostile  areas,  land 
offers  concealment  and  refuge  to  hostile  land, 
sea  and  air  forces. 
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The  CPF  relies  heavily  on  aircraft  support,  in 
these  missions,  to  provide  warning  and 
protection  against  threats  like  fast-attack 
aircraft,  land-based  anti-ship  systems  and 
fast-patrol  boats. 

A  Maritime  UAV  system  offers  CPF  the  ability 
to  deploy  multiple  air  vehicles,  providing 
simultaneous  real-time  coverage,  over  a 
wider  area  than  one  manned  aircraft  can 
survey.  (The  smaller  size  of  the  UAVs  simply 
permits  more  UAVs  than  helos  to  be  operated 
off  the  same  ship.) 

If  hostile  forces  are  suspected  to  be  in  a 
particular  area,  CPF  is  able  to  vector 
one  or  more  UAVs  to  investigate.  The  manned 
aircraft  provides  CPF  with  an  extended 
communications  horizon  with  the  UAV(s), 
until  the  hostility  of  the  threat  is  established. 


In  the  event  that  a  hostile  target  is  detected 
in  this  mission,  a  UAV  with  an  imaging 
payload  offers  CPF  a  capability  for  real-time 
target  classification,  designation  and  battle 
damage  assessment  support,  without  placing 
the  manned  aircraft  at  risk. 


When  the  target  is  concealed  from  CPFs  radar 
systems,  likely  mission  phases  are' 

I.  Surveillance.  CPF  monitoring  passive 

sensors,  including  DF  and  ESM  and  visual 
observers;  Supporting  aircraft  monitoring 
infra-red,  radar,  ESM,  DF  sensors,  and 
conducting  visual  surveillance,  as 
appropriate; 

2  Detection:  detecting  possible  targets,  with 

one  or  more  sensors, 

3.  Classification:  estimating  probable  target 
type,  capabilities  and  intentions,  on  the 
basis  of  detected  signatures,  intelligence 
and/or  third-party  data; 

4.  Localization:  estimating  probable  target 
position,  and  possibly  direction,  range, 
course  and/or  speed,  with  uncertainties; 

5  Tracking'  refining  the  estimated 
position,  course  and  speed  data,  and 
establishing  an  estimated  state  vector  tor 
the  target,  and 

6  Engagement:  planning  and  executing  an 
attack  against  the  target,  monitoring  its 
effectiveness,;  and  responding,  as 
appropriate,  with  self-defenses  and/or 
additional  hostilities 

Throughout  the  mission,  voice  and  tactical 
data  link  communications  aie  also  probable, 
between  CPF,  supporting  aircraft,  and/or 
other  cooperating  forces. 


4.2  ASuW  Mission  Potential  of 
Various  UAV  Payloads 

Long-range  surveillance  and  engagement  of 
surface  targets  in  the  open  ocean  is  obviously 
very  different  from  close-range  coastal  patrol 
operations.  The  differences  in  physical  and 
geopolitical  environmental  assumptions  will 
impose  significantly  different  considerations 
on  the  mission  system  requirements  analysis 

In  the  rest  of  this  section,  the  practical 
mission  value  of  a  selected  subset  of  th 
possible  UAV  payloads  are  explored 

The  payloads  judged  to  be  most  useful  in 
support  of  these  CPF  ASuW  operations  are: 

1.  Imaging  Systems,  such  as: 

a.  Forward-Looking  Infra-Red  (FLIR); 

b.  Low-Light  Television  (LLTV);  and 

c.  Synthetic-Aperature  Radar  (SAR); 

2.  Electronic  Support  Measures  (ESM); 

3.  Electronic  Counter  Measures  (ECM);  and 

4  Radio-Frequency  Relays  (RFR) 

A  single  UAV  may  be  fitted  with  only  one  or 
with  combinations  of  these  payloads, 
according  to  the  relative  importance  of 
mission  payload  performance  requirements 
versus  mission  vehicle  performance 
requirements. 

The  larger  UAV  mission  payloads  reduce  time 
on  station.  Some  missions,  on  the  other  hand, 
may  require  a  variety  of  payload  capabilities, 
depending  upon  how  events  develop  during 
the  mission. 

Table  3  indicates  in  which  phase(s),  of  which 
mission(s),  each  payload  could  be  useful. 


ASuW  Missions 

.. 

Mission  Phase 
Code: 

Payload 

Long-Range 

Engagements 

Coastal  Patrols 

FLIR 

S,D,C,L,T,E 

S,D,C,L,T,E 

S=Surveillance 

l>Deiection 

LLTV 

S,D,C,L,T,E 

S,D,C,L,T,E 

Classification 

^Localization 

SAR 

s.dXxe 

S,D,L,T,E 

T=Trackmg 

.E=Engagemcm 

ESM 

S,D,C,E 

S,D,C,E 

TOTacocal 

.Commumcauons 

ECM 

C,  E 

C,  E 

RFR 

S,D,C,E,TC 

S,D,C,E,TC 

Table  3.  Mission  Phase/UAV  Payload 
Concordance 
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The  Mission  Phase  has  been  mapped  into  this 
table,  in  order  to  observe  the  following: 

1.  The  payloads  are  all  useful  in  the  same 
mission  phases  of  the  two  vastly  different 
ASuW  missions; 

2.  The  same  payload  equipment  may  satisfy 
different  tactical  mission  requirements, 
according  to  the  manner  and  the  context 
m  which  it  is  employed.  Conversely,  the 
same  mission  phase  requirement  may  be 
satisfied  in  a  variety  of  different  ways, 
according  to  the  capabilities  of  the 
available  payload. 

The  creative  tactical  employment  of  existing 
payloads  in  non-traditional  ways  may 
sometimes  offer  an  alternative  solution  to  the 
development  of  hybrid  or  multi-function 
payloads.  For  example,  the  Radio  Frequency 
payload  (RFR)  is  more  commonly  called  a 
communications  relay.  In  this  paper  the  more 
generic  term  RFR  is  deliberately  used,  to 
encourage  the  reader  to  consider  an  ESM-like 
mission  application  and  an  ECM-like 
application  (see  para  4.2  4) 

In  the  following  subsections,  we  expand 
further  upon  the  manner  in  which  each  type 
of  payload  would  support  these  missions 


4.2.1  ASuW  Mission  Employment  of 
UAVs  with  Imaging  Payloads 

Imaging  payloads  offer  significant  advantages 
in  support  of  combat  ships. 

The  most  obvious  advantage  is  the  "bird's  eye 
view"  of  the  surface,  which  any  air  vehicle 
provides.  While  manned  aircraft  can  also 
provide  this  perspective,  the  UAV  approach 
permits  shipboard  personnel  to  make  their 
own  interpretation  of  the  situation, 

eliminating  one  level  of  ambiguity  from  the 
tactical  assessment  process.  First-hand 
observation  provides  the  tactical  officer  with 
classification  and  situation  assessment  data 
matched  by  no  other  sensor  subsystem 

Real-time  video  images  of  a  target  allow  the 
ship's  command  to  determine  threat 
parameters  which  are  difficult  or  impossible 
to  discern  by  other  means,  such  as  nationality 
of  flag,  deck  activity,  weapon/sensor  system 
fit  and  current  degree  of  combat-readiness. 
During  an  engagemt  nt,  LLTV  and  FL1R 
imagery  will  provide  indication  of  fall-of-shot, 
and  inflicted  battle  damage,  as  well  as 
detecting  enemy  weapon  firings. 


In  non-combat  scenarios,  like  peace-keeping 
and  fisheries  patrol,  a  video  recording  of 
covertly  acquired  observations  like  this  can 
provide  invaluable  evidence  with  which  to 
prosecute  violators. 

FLIR  allows  the  assessment  of  internal 
conditions,  which  would  not  be  apparent  on 
normal  TV  images. 

A  SAR  offers  significant  advantages  in  poor 
weather  conditions.  The  use  of  an  active 
sensor  is  not  always  tactically  desirable, 
however,  and  SAR  image  resolution  is 
typically  much  lower  than  FLIR  or  LLTV. 
Only  major  structural  damage  can  be 
observed.  A  SAR  payload  will  be  most  useful 
in  combination  with  another  passive 
surveillance  sensor  (such  as  ESM). 

With  their  relatively  small  field  of  view 
(compared  with  ESM),  and  their  vulnerability 
to  obstruction  by  low  cloud  cover,  FLIR  and 
LLTV  are  better  suited  to  Coastal  Patrol 
support,  than  Long-Range  Engagements,  for 
the  Surveillance  and  Detection  phases  of  the 
mission.  Coastal  Patrol  search  areas  will  be 

closer  to  the  host  ship,  and  the  area  to  be 
searched  will  be  relatively  well  defined.  Long 
Range  engagements  will  require  the  UAV  to 
travel  long  distances,  and  small  uncertainties 
in  defining  the  search  area  will  result  in  more 
lost  useful  search  time. 

Effective  use  of  FLIR  and  LLTV  requires  areas 
of  uncet'ain  target  location  of  less  than  100 
sq.nm  The  UAV  is  then  used  to  detect, 
classify,  and  localize  the  target  to  within 
500m  CEP  for  a  firing  solution  and  BDA. 

Table  3,  we  credit  FLIR  with  being  useable 
when  searching  for  targets  which  have 
substantial  temperature  differential  from  the 
environment.  Some  analysts  contend  that 
FLIR  is  best  packaged  with  another,  wide- 
area,  surveillance  payload,  like  ESM  or  SAR,,  to 
facilitate  self-cueing  of  targets  to  investigate 
with  FLIR,  on  arrival  in  the  search  sector. 

NOTE.  Some  date  link  bandwidths  are 
insufficient  to  support  real-time  video  images 
at  high  resolutions  (see  section  4  3),  but  that 
does  not  in  itself  mean  that  imaging  payloads 
cannot  be  exploited  with  those  data  links: 

Any  single  frame  image  is  one  more  than 
the  ship  had  before,  for  classification 
purposes. 

Slow  frame-rates  (<  1  frame  per  second) 
will  suffice  for  monitoring  most  surface 
ship  targets; 
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The  payload  itself  could  capture  video  at 
a  faster  frame  rate  than  the  data  link 
would  allow,  and  then  transmit  images  in 
compressed  format  and/or  in  non-real 
time,  if  data  latency  was  not  a  mission- 
critical  parameter; 

The  payload  could  combine  several 
sequential  images  into  a  single  composite 
image,  either  tiled  or  overlaid,  to  show 
changes  over  a  time  interval,  while 
transmitting  only  a  single  video  frame. 

4.2.2  ASuW  Mission  Employment  of 
UAVs  with  ESM  Payloads 

Employment  of  UAV-mounted  ESM  payloads 
would  provide  ships  with  two  advantages; 

1.  One  additional  perspective,  from  each 
deployed  UAV,  allowing  cross-fixing  of 
brief  contacts,  and 

2.  An  extended  threat  surveillance  horizon, 
due  to  the  increased  antenna  altitude,  and 
the  mobility  of  the  UAV. 

Knowledge-based  systems  are  already 
achievable,  in  which  the  ESM  payload  could 
classify  detected  emissions  according  to  an 
onboard  threat  library,  if  data  link  bandwidth 
were  an  issue. 

Alternatively,  pulse  descriptor  worua  may  be 
relayed  back  to  the  host  ship  for  a  centralized 
analysis.  In  this  approach,,  multiple 
independent  sensors  and  operator  intelligence 
could  be  ''fused",  to  hypothesize  the  existence 
and  location  of  particular  platforms  known  to 
be  fitted  with  the  observed  emitters 

An  ESM  UAV  may  prove  useful  by  operating 
covertly  close  enough  to  hostile  forces  to 
detect  emissions  which  are  beyond  CPF's  ESM 
horizon  It  is  also  reasonable  to  suggest  that 
CPF  may  choose  to  use  the  UAV  to  incite  a 
hostile  force  into  using  their  radars  to 
investigate  and  respond  to  the  apparent 
threat. 

This  latter  strategy  suggests  that  an  ESM 
payload  would  be  useful  in  combination  with 
an  active  payload,  such  as  SAR,  ECM  or  even 
RFR. 

A  SAR  payload  would  permit  searching  for 
''silent"  threats,,  and  may  incite  a  curious 
threat  to  employ  its  own  radar  to  investigate 
the  UAV.  The  ESM  payload  would  then  relay 
back  observed  data  on  the  radiator(s),  to  aid 
in  target  classification  and  localization. 

An  ECM  or  RFR  payload  could  be  used  to  spoof 
and  jam  the  threat,  to  excite  a  hostile  reaction 


if  one  was  forthcoming,  and  to  confound  the 
target's  defence  systems,  at  least  partially 
concealing  CPFs  HARPOON  attack.  The  ESM 
payload  would  relay  back  information  on  the 
target's  use  of  surveillance  and  fire-control 
radars  and  Electronic  CounterMeasures, 
providing  CPF  with  a  measure  of  the 
imminence  of  any  counter  attack. 

4.2.3  ASuW  Mission  Employment  of 
UAVS  With  ECM  Payloads 

There  is  a  variety  of  dissimilar  ECM  payloads, 
which  could  be  adapted  into  UAV  systems. 

The  primary  advantage  of  fitting  such 
payloads  to  the  UAV,-  as  opposed  to  any  other 
type  of  platform,  is  the  unique  combination  of 
mobility  and  expendability 

Onboard  ECM  systems  are  designed  to  defend 
the  platforms  on  which  they  are  mounted. 
Some  manned  aircraft  have  actually  been  cast 
in  the  role  of  manned  decoy,,  interposing 
themselves  between  the  missile  threat  and 
their  ships.  These  aircraft  rely  upon  their 
own  maneuverability  and  OffBoard  ECM 
systems  to  protect  themselves  after  decoying 
the  missile  away  from  the  ship. 

An  UAV  may  be  the  ideal  alternative  solution 
for  this  mission. 

The  mission  analyst  must  consider  such 
factors  as: 

what  degree  of  onboard  payload 

sophistication  is  required,  according  to 

the  number  of  different  missile  types  to 

be  countered  by  the  same  UAV; 

how  to  provide  target 

detection/designation  and  tracking 

support  to  the  ECM  function;, 

how  to  coordinate  ECM  operations  in  the 

company  of  friendly  forces; 

how  much  protection  each  UAV  could 

reliably  provide  to  which  escorted 

platform(s),  by  itself,  and 

the  degree  to  which  ECM  UAVs  could 

support  each  other 

A  repeater  payload  would  seem  to  be  a 
particularly  useful  choice.  Particularly  in 
combination  with  an  ESM  payload,  as 
suggested  in  the  previous  section  If 
illuminated  with  a  radiator,  it  might  confuse 
hostile  threat  assessment  systems  into 
believing  the  UAV  was  another  platform  of 
the  same  type  as  the  illuminator  Automated 
threat  analysts  systems  may  be  particularly 
vulnerable  to  confusion  when  faced  with  such 
behavior 
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4.2.4  ASuW  Mission  Employment  of 
UAVs  with  RFR  Payloads 

When  operating  in  the  capacity  of  an  Outer 
ASW  Screen  "picket",  CPF  wil!  be  in  excess  of 
lOOnm  from  the  screened  units.  This  distance 
is  necessary,  partly  to  remove  the  Tactical 
Towed-Array  Sonar  (TACTAS)  sufficiently  far 
away  from  the  noise  of  the  escorted  units,  and 
partly  to  establish  a  substantial  protection 
perimeter  around  those  units. 

It  will  be  particularly  problematic  for  CPF  to 
remain  in  communication  with  the  rest  of  the 
Tactical  Force,  when  on  "picket"  duty.  Their 
long  range  and  low  antenna  horizon  will 
preclude  intership  communications  at  UHF  or 
VHF  frequencies,  and  the  threat  of  detection 
and  localization  will  discourage  the  use  of  HF. 

The  need  for  resolution  and  low  cloud  cover 
may  both  force  a  FLIR  or  LLTV  UAV  to 
operate  at  altitudes  below  600  m.  At  that 
altitude,  CPF  would  lose  contact  at  ranges 
between  45  and  70  nm  or  greater.  For  that 
reason,  the  ship's  helo  or  another  UAV  may 
need  to  serve  as  a  UAV  system  data  link 
relay 

As  suggested  in  Table  3,  and  in  section  4,2.2, 
above,  the  RFR  payload  may  also  prove  quite 
valuable  in  the  engagement  phase  of  a 
mission  CPF  could  use  the  RFR  to  spoof  the 
target  into  thinking  the  UAV  was  a  surface 
ship  or  aircraft,-  emitting  the  relayed 
communications.  CPF  could  also  employ  the 
RFR  to  relay  back  whatever  communications  it 
detected.  In  this  mode,  the  RFR  would 
support  Surveillance,  Detection,  Classification 
and  Engagement  phases  of  missions. 


In  short,  an  RFR  payload  can  be  used- 

1  To  extend  the  Tactical  Data  Link  and 
voice  communications  horizon  between 
widely  dispersed  navai  escort  units  (as 
alternative  to  SATCOM  or  HF 
communication  links); 

2  To  maintain  coi.'municalions  with  other 
UAVs,  when  their  operations  force  them 
below  the  ship-to-U3V  communications 
horizon; 

3  To  survey  the  RF  spectrum,  for  channel 
occupancy  detection  and  reporting,  with 
or  without  the  relaying  of  intercepted 
communications  to  the  host  platform,  for 
further  evaluation;  and 

4.  To  issue  deceptive  and/or  corruptive  RF 
message  traffic,  intended  to  deny 


portions  ot  the  RF  spectrum  to  the  enemy 
and/or  to  spoof  the  enemy's  ESM 
systems. 

The  RFR  payload  is  also  the  payload  most 
likely  to  be  compatible  with  the  existing 
shipboard  equipment  with  which  it  is 
designed  to  interact.  This  may  make 

integration  into  the  CPF  combat  system 
particularly  easy. 

4.3  UAV  System  Data  Link  Issues 
4.3.1  General 

The  Maritime  UAV  System  communication 
functions  must  support. 

1.  A  payload  data  downlink  from  the  m- 
fiignt  UAV(s)  to  the  ship's  combat  system 
subsystems  and  workstations  capable  of 
exploiting  that  data;  and 

2.  A  bi-directional  exchange  of  mission 
orders  and  system  status  data  between 
the  ship  and  the  UAV(s). 

The  mission  orders/systems  status  datalink(s) 
must  at  least  support. 

1  coordinated  control  and  operation  of  the 
payloads  of  at  least  two  UAVs,  one  of 
which  may  be  a  UAV  datalink  relay  (to 
allow  operation  of  imaging  payload  UAVs 
at  altitudes  below  600m,  at  ranges  up  to 
lOOnm  from  the  host  ship);  and 

2  simultaneo'i-  operation  of  at  least  four 
UAV  vehic.es 

There  are  at  least  three  options  for 
implementing  these  Ship-to-U  AV-to-Ship 
datalinks.  Any  one  of  them  may  be  dedicated 
to  air  vehicle  management,  and/or 
incorporate  the  payload  data  downlink. 

The  options  are. 

1 .  Fitting  a  dedicated  U  \V  datalink  function 
to  the  ship; 

2  Retrofitting  a  UAV  control  function  into 
one  or  more  existing  transceiver 
subsystem!  s);  or 

3  Exploiting  an  existing  Tactical  Data  Link 


4.3.2  Implementing  a  Single  Dedicated 
Ship  to-UAV  Up/Down  Data  Link 

Transmitting  real-time  high-resolution  video 
images  from  UAV  to  ship,  at  ranges  in  the 
order  of  lOOnm  places  significant  demands  on 
the  UAV-to-ship  payload  data  downlink. 


Once  an  imaging  payload  has  been  integrated 
into  the  UAV  system,  however,  the  same  data 
distribution  and  exploitation  functions  will 
serve  t'"*  interpret  and  distribute  the  data 
from  any  other  imaging  payload,  as  long  as 
the  image  is  in  the  same  standard  format. 
This  advantage  may  be  subtle,  but  of  all  the 
practical  issues  involved  in  the  retroactive 
integration  of  UAV  systems  into  existing 
combat  systems,  this  one  factor  is  likely  to  be 
the  most  significant  factor,,  in  trade-off 
analyses. 


4.3.3  Retrofitting  UAV  Dataiink 
Function  into  Existing 
Transceiver  Subsystem 

The  relative  merits  of  this  second  option  over 
the  first  one  would  need  to  be  studied  on  a 
case-by-case  basis. 

If  the  retrofit  were  a  simple  matter  of  adding 
a  UAV-specific  interface  to  a  system  of 
otherwise  similar  function,  then  there  may  be 
significant  advantages  to  this  approach. 


The  most  practical  dataiink  option  for  a  UAV 
system  using  imaging  payload  UAV?  appears 
to  be  a  dedicated  downlink. 

If  the  systttr  is  intended  to  employ  imaging 
payloads  from  the  beginning,  then  it  may  be 
most  appropriate  to  install  a  bi-directional 
link,  and  to  employ  (he  same  dataiink  for 
UAV  mission  orders  and  status  reporting. 

The  advantages  of  this  approach  include: 

the  ability  to  implement  a 
communications  link  optimized  to  the 
UAV  mission  requirements,;  rather  than 
compromising  payload  and  mission 
requirements  to  "fit"  the  limitations  of 
existing  systems;, 

the  freedom  to  optimize  the  design  of  the 
UAV-fitted  elements  of  the  dataiink 
system; 

the  freedom  to  design  a  suite  of 
equipment  which  is  independent  of 
specific  ship's  characteristics,  to  th<’ 
maximum  extent  possible,  thus  more 
easily  ensuring  interoperability  ol  UAVs 
between  different  ship  classes  (and 
nations); 

There  are  disadvantages  also' 

it  may  not  be.  simple  to  install  a 
directional  transreceiver  system,  with 
upwards  of  35dB  S/N  ratio,  at  C  band 
(one  currently  favored  UAV  dataiink 
comms  frequency),  without  compromising 
existing  antenna  systems, 
the  ship-to-UAV  uplink  would  not  need 
anywhere  near  the  bandwidth  of  the 
video  payload  downlink. 


If  the  intention  was  to  employ  non-imaging 
payloads,  (e.g  ,  RFR  applications  only),  then 
one  of  the  following  alternatives  may  prove 
more  a;fordable  or  appropriate  In  that  case, 
the  subsequent  introduction  of  imaging 
payloads  may  only  require  the  addition  of  a 
dedicated  payload  data  downlink 


If  the  UAV  itself  was  likely  to  only  ever 
operate  with  one  particular  payload,  and  that 
payload  would  normally  interface  with  an 
existing  shipboard  control/daia  link,  then  this 
strategy  would  be  the  best  choice  In  addition 
to  exploiting  existing  equipments,  such  a 
scenario  would  likely  find  that  the  UAV 
payload  operator  would  be  the  usual  operator 
of  the  sensor  subsystem  with  which  the 
payload  was  communicating.  (An  example  ot 
this  might  be  a  communical  ons  relay 
payload). 

It  is  unlikely,,  however,  thai  this  strategy 
would  always  serve  equally  well  for  both 
UAV  vehicle  control  and  payload  control, 
since  payload  control  is  not  traditionally  the 
province  of  the  air  vehicle  controller. 

The  dis’ributed  architecture  of  the  CPF 
SHINPADS  is  particularly  advantageous,  in 
this  respect  The  payload  and  air  vehicle 
control  functions  may  be  implemented  at  any 
combination  of  consoles  and  still  be  collected 
and  coordinated  through  a  single  retrofitted 
UAV  system  dataiink  processor,  added  onto 
the  databus. 

Some  analysts  may  consider  evaluating  the 
use  of  existing  systems  like  AN/SLQ-32, 
JTIDS,  IFF,  and  LAMPS,  to  integrate  UAVs  into 
existing  tactical  control  and  data  analysis  and 
exchange  networks.  If  other  countries 
eventually  choose  to  proceed  this  way,,  a 
dedicated  UAV  dataiink  may  be  the  only  way 
for  CPF  to  achieve  interoperability  with  those 
UAVs  (ie.:  by  emulating  the  chosen 
datalink(s))  (Interoperability  of  UAVs  is  one 
of  the  Maritime  UAV  System  performance 
objectives  of  NATO  PG-35). 

4.3.4  Exploiting  An  Existing  Tactical 
Data  Link 

Any  combat  system  already  designed  to 
control  aircraft  is  likely  to  include  a  dedicated 
operator  (such  as  ’he  Anti-Submarine  Aircaft 
Controller  (ASAC),  on  CPF),  already  trained  tn 
air  traffic  control  and  safely  He  would 
already  have  control  over  the  functions  by 
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which  to  exchange  air  vehicle  navigation  and 
mission  control  orders  and  status  messages 
with  Tactical  Link  capable  platforms. 

Minimal  special  hardware  or  software 
additions  would  need  to  be  made  to  existing 
ships’  combat  systems,  to  support  this  type  of 
interface.  Control  of  vehicle  and  payload  could 
be  handed-over  between  existing  NATO 
platforms  compatible  with  the  same  Tactical 
Data  Link  specifications 

A  single  UAV  could  simultaneously  support 
all  platforms  on  the  same  Tactical  Data  Link 
network 

The  "downsides"  to  this  approach  are  that. 

the  Tactical  Data  Link  messages  tend  to 
be  inadequate  to  transmit  the  wealth  of 
sensor  payload  data  which  could 
otherwise  be  relayed  for  shipboard 
processing  (this  is  particularly  true  with 
imaging  payloads), 

weight  and  security  issues  may  preclude 
this  option  when  Crypto  devices  are  used 
on  the  Tactical  Data  Link,  and 
if  the  UAV  recovery  phase  required  close 
control,  then  it  would  probably  be 
unacceptable  to  have  use  of  the 
communications  link  limited  by  polling 
sequence  There  may  also  be  a  practical 
problem  of  linc-of-sight  masking,, 
between  the  Tactical  Data  Link  antenna 
and  the  flight  deck 

Some  analysts  are  investigating  the 
adaptability  of  Link  16  (JTIDS)  to  this 
application  CPF  is  fitted  only  with  Link  14 
and  11,  neither  of  which  appears  adaptable  to 
video  image  transmission. 

4.4  UAV  System  Management 

4.4.1  Mission  Planning  and  Direction 

UAV  Systems  will  be  managed  by  the  ship's 
combat  sy«tem  crew  UAVs  will  be 

dispatched  on  missions,  as  would  any  other 
controlled  air  asset  In  order  to  employ 
UAVs,.  the  shipboard  element  of  the  UAV 
System  w.!!  require  mission  planning, 
situation  monitoring  and  in-process  mission 
modification  functions. 

The  mission  planning  functions  will  be  at  least 
partially  present  on  CPF,  all  the  more  so  once 
the  NSA  Shipboard  Tactical  Support  System 
(STSS)  has  been  integrated.  The  UAV  is 
designed  to  be  programmed,  via  the  ship-tc- 
UAV  data  uplink  An  umbilical  link  provides 
fer  pre-launch  transfei  of  mission  orders  to 
the  vehicle,  under  EMCON  silent  conditions. 


Situation  monitoring  and  in-flight  re¬ 
programming  of  air  vehicle  and/or  payload 
performance  will  be  implemented  by 
incorporating  a  bi-directional  communication 
link  between  the  combat  system  and  the 
UAV. 

Control  of  the  payload  and  of  the  air  vehicle 
will  be  exercised  by  the  appropriate  ship's 
combat  system  personnel  The  air  vehicle 
itself  will  most  likely  be  managed  by  the 
ASAC.  The  payload  management 
requirements  need  study  The  specific 
manner  in  which  these  functions  should  be 
implemented  on  CPF  would  be  driven  by  the 
nature  and  the  sophistication  of  the  UAV 
exploitation  capability  requirements 

4.4.2  Payload  Data  Exploitation 

The  mission  value  of  a  UAV  payload  is 
directly  proportional  to  the  ability  of  the 
shipboard  combat  system  to  "exploit"  that 
data. 

4.4. 2.1  Payload  Management 

Each  type  of  payload  in  section  4.2  exhibits 
characteristics  which  necessitates  payload 
management  messages  unique  to  those 
characteristics.  Full  exploitation  of  individual 
payloads  of  the  same  type,  may  further 
necessitate  specific  modifications  to  the 
messages  by  which  each  payload  variant  is 
managed 

As  mentioned  in  section  4  3.2,  however,,  the 
data  exploitation  functions  which  support 
management  of  imaging  payloads  are  likely  to 
have  a  high  degree  of  commonality.  Even 
non-imaging  payloads  (such  as  ESM)  can  be 
programmed  to  format  and  transmit  a  video 
page,  in  lieu  of  discrete  messages  While  this 
may  seem  inefficient,  it  may  provide  a 
solution  to  interoperability  of  UAVs  with 
payloads  not  generally  possessed  by  all 
forces,,  without  the  necessity  to  modify  each 
ship's  payload  data  management  functions  to 
exploit  those  payloads 

It  is  generally  accepted  that  exploiting  the 
data  from  an  imaging  payload  requires  at 
least  the  following  functions 

1 .  a  video  display  annotation  function; 

2.  a  freeze  (video)  frame  function; 

3.  a  video  display  rotation  function; 

4.  an  image  magnification  /minimization 
function, 

5.  a  range  distortion  correction  function, 

6  a  video  recording  function, 

7  a  recorded  video  playback  function 
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Where,  in  the  Maritime  UAV  System,  these 
individual  functions  are  implemented  will 
have  significant  bearing  on  the  component 
and  the  interface  design  and  integration 
tradeoffs. 

A  dedicated  Maritime  UAV  console  may  be 
able  to  provide  all  the  functions  itself,  but  in 
some  applications  the  need  for  a  dedicated 
console  may  be  an  unacceptable  operational 
constraint. 

Various  existing  ship's  combat  system 
consoles  may  provide  all,,  some  or  none  of 
these  functions,  in  different  ways.  Solutions 
which  minimize  impact  to  existing  systems 
may  present  an  obstacle  to  the  development 
of  a  "universal"  Maritime  UAV  System. 

In  some  cases,  the  specific  mission 
requirements  of  different  customers  may 
dictate  different  optimal  approaches  to  the 
same  function,  (eg:  For  some  applications, 
image  magnification  may  be  best  done  by 
modifying  the  focal  length  of  the  lens  on  the 
payload,  in  real  time.  This  may  create  a 
unique  requirement  for  the  associated  control 
and  status  messages  on  the  datalink.  For 
other  applications,  image  magnification  must 
be  performed  on  the  historical  image, 

mandating  extremely  high  real-time  image 
resolutions,  video  compression  techniques, 
and  high  downlink  data  rates ) 

4,4. 2. 2  Routing  UAV  Payload  Data  to 

Combat  System  Console  Operators 

The  CPF  combat  system  architecture  offers  at 
least  3  ways  of  distributing  UAV  payload  data 
to  the  existing  operator  consoles. 

1  Video  Data  Distribution:  whether  the 
payload  data  is  visual  imagery,  or 
whether  the  data  has  been  formatted  into 
a  video  image,  once  the  data  has  been 
downlinked  and  converted  into  an  RS343 
or  RSI 70  video  signal,  it  can  be  selected 
to  any  combination  of  the  Standard 
Display  consoles,  v:a  the  CPF  Video 
Distribution  Unit 

2.  Tactical  Data  Link  Data  Distribution  if 
the  UAV  is  able  to  operate  on  a  Tactical 
Data  Link,  then  it  can  function  as  a 
Reporting  Unit  (RU).  All  tactical  data 
messages  would  then  be  processed  and 
distributed  through  the  existing  Data  Link 
processing  functions. 

3  The  CPFs  (SHINPADS’)  distributed  combat 
system  architecture  also  permits  the  easy 
addition  of  new  sensor  subsystems  onto 
the  command  and  control  system  serial 
databus  Once  the  new  subsystem  is  on 
the  bus,  it  is  straightforward  to  program 


a  message-handling  interface  software 
module,  to  recognize,  process  and  route 
the  new  message  traffic.  UAV  sensor 
data  reports  would  need  to  be  referenced 
from  the  UAV  position,  rather  than  from 
ownship's  position,  through.  This  could 
be  done  by  modifying  the  tactical 
database,  to  create  data  stores  for  UAV 
sensor  reports,  or  by  routing  the 
messages  to  the  Link  1 1  processing 
software  as  if  it  had  been  received  via 
Link  1 1  from  a  UAV  functioning  as  an  RU. 

4.4.2.3  Fusing  UAV  Payload  Data  In  the 
Ship's  Combat  System 

As  with  all  information  management  systems, 
the  volume  of  data  which  a  field  of  multi¬ 
sensor  UAVs  will  be  able  to  acquire  will 
rapidly  exceed  the  capacity  of  existing  combat 
systems  to  assimilate.  The  problem  will  not 
be  UAV  payload  data  link  bandwidth,  so 
much  as  Combat  System  information 
processing  throughput. 

One  technology  which  offers  a  potential 
solution  to  this  information  management 
problem  is  Multi-Sensor  Data  Fusion. 

At  its  simplest,  UAV  data  may  be  "fused"  with 
existing  combat  system  data  by 
simultaneously  displaying  the  video  imagery 
derived  from  them  both,  (e.g  •  displaying  a 
FLIR  image  of  a  target  in  a  "window",,  on  the 
same  display  as  the  ship's  own  radar  image 
and  tactical  (NTDS  symbol)  plot). 

More  complex  data  fusion  systems  may  cross¬ 
correlate  UAV,.  Ownship,  Tactical  Data  Link, 
and  threat  library  data,  to  achieve  any 
combination  of  the  following- 

contact  classification,  by  cross-correlation 
of  platform  signature  data  with  known 
threat  characteristics; 
inference  of  contact  presence  and/or 
intentions,  by  cross-correlation  of  sensor 
subsystem  signals  and  "noise",  from 
dissimilar  sensors;  and 
target  localization  and  tracking,  by  cross¬ 
correlation  and  filtering  of  independently 
located  passive  sensor  subsystems 

Knowledge-based  image  recognition  systems 
could  be  programmed  to  "recognize”  targets, 
according  to  unique  signature  data  as  vague 
as  their  silhouette  or  as  specific  as  their  hull- 
numbers. 

Payloads  could  be  programmed  to  transmit 
video  images  containing  specific 
preprogrammed  events  (e  g..  missile  launch 
eve  ts,  might  be  detectable  as  a  sudden 
increase  in  UV  and  1R  spectral  content) 

With  the  successful  implementation  of 


reliable  multi-sensor  data  fusion  systems,  the 
introduction  of  multi-vehicle  UAV  systems  in 
support  of  future  naval  forces  may  become  as 
routine  as  the  deployment  of  sonobuoys. 

A  widely  distributed  field  of  dissimilar 
sensors  will  provide  a  single  ship's  combat 
system  with  simultaneous  statistically 
independent  measurements  of  spectrally- 
independent  signature  characteristics  in  a 
significantly  larger  area  than  it  is  able  to 
monitor  with  ship-mounted  sensors  alone. 


5.  Conclusion 

Exercises  l.ke  JANTIDE  and  MAVUS  confirm 
the  viability  of  CL-227  Sea  Sentinel  System 
mission  Roles  and  Tactics  in  support  of 
Maritime  Forces. 

The  CPF  is  Canada's  latest  warship,  similar  in 
configuration  and  mission  to  missile  carrying 
frigate  in  the  MAVUS  exercise,  but  with  the 
added  advantage  of  a  C2  system  which  uses 
the  SHINPADS  open  architecture 

Integrating  a  Maritime  UAV  system  into  the 
CPF  Combat  system  offers  at  least  the 
following  significant  enhancements  to  her 
already  impressive  capabilities: 

1.  A  low  cost  complement  to  manned 

aircraft  deployment,  in  support  of 

OT11  missions,  such  as  Over  The 
Horizon  Targeting,  Battle  Damage 
Assessment  and  Naval  Gun  Support. 

2.  A  Stand-off  ECM  capability 

3.  Tactical  opt'  ns  which  would  be 
unacceptably  risky  with  manned 
vehicles,  such  as  deliberately  provoking 
responses  from  suspected  hostiles. 

4.  The  ability  to  simultaneously  operate 
multiple  airborne  surveillance  vehicles, 
off  a  frigate  designed  to  host  one 
helicopter. 

5.  An  organic  aerial  surveillance 
capability,  even  when  the  helicopter  air 
detachment  is  not  embarked. 

6.  A  low  cost  airborne  communications 
relay,  to  maintain  UHF  contact  between 
widely  dispersed  units 


As  data  fusion  processes  automatic  target 
detection  software  and  expert  systems 
technologies  mature,  multiple  vehicle  UAV 
systems  will  become  common  extensions  to 
surface  surveillance  and  targeting  systems. 
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1.  SUMMARY 

This  paper  describes  a  system  including 
integrated  fire  control  algorithms, 
software,  and  related  control  and  display 
concepts  for  air-to-air  combat  in  the 
multiple-target  environment  of  the  1990's. 
This  system,  now  completing  advanced 
development,  fuses  data  from  multiple 
sensors  and  presents  integrated  fire 
control  information  to  the  pilot  in  a 
simplified  manner  for  improved  situation 
awareness  and  decreased  workload.  The 
resulting  algorithms,  software,  and  display 
concepts  are  described  in  this  paper.  The 
system  has  been  demonstrated  and  evaluated 
on  a  flight  simulator  with  Air  Force 
pilots.  The  fire  control  software,  which 
was  developed  in  the  Ada  language,  was 
implemented  in  a  distributed  data 
processing  complex  of  the  PAVE  PILLAR  type,, 
using  MIL-STD-1750A  processors.  The 
sensors  and  data  links,  as  well  as  tha 
aircraft  and  its  environment,  were 
simulated  by  mathematical  models. 

2 .  INTRODUCTION 

In  the  air  combat  environment  of  the 
1990 ' 8 ,  an  air-to-air  fighter  will  need 
improved  multiple-target  engagement 
capability  compared  to  current  aircraft. 

One  of  the  reguired  improvements  is  a  fire 
control  system  with  improved  capability  to 
aid  the  pilot  in  attacking  multiple 
targets.  This  paper  describes  an 
integrated  fire  control  system  using 
improved  computers,  sensors,  and  an 
intraflight  data  link  which  are  expected  to 
be  available  in  the  1990's.  The  purpose  of 
the  system  is  to  provide  the  pilot  with 
easily  understood  attack  management 
information,  while  leaving  major  decisions 
in  his  hands.  Computers  with  the  necessary 
storage  and  throughput  capacity  are 
available  now.  The  improved  sensors, 
particularly  an  electronically  scanned 
array  (ESA)  radar  for  multiple  target 
tracking,  and  an  intraflight  data  link 
capable  of  high-data-rate  transfer  of 
information  between  aircraft  operating  at 
mutual-support  range,  are  expected  to  be 
available  in  the  1990's.  The  algorithms, 
software,  and  control  and  display  concepts 
developed  in  this  program  are  to  be 
implemented  on  such  equipment  to  provide 
the  pilot  with  easily-understood  attack 
management  information  with  reduced 
workload. 

3.  SY8TEM  DESCRIPTION 

The  avionic  system  for  which  the  software 
and  pilot/vehicle  interface  concepts  were 
developed  is  shown  in  Figure  1.  It  is 
intended  to  be  for  a  representative 
single-place  air-to-air  fighter  of  the 


1990's,  armed  with  medium-range  radar- 
guided  missiles,  short-range  infrared- 
guided  missiles,  and  a  gun.  The  sensors 
and  data  links  used  in  the  system  were 
represented  by  mathematical  models  in  the 
flight  simulator.:  The  ESA  radar  has  a 
phased-array  antenna  in  which  the  direction 
of  the  transmitting  and  receiving  beam  can 
be  controlled  instantaneously  by 
controlling  the  phase  shift  of  the  many 
individual  elements  of  the  antenna.  The 
computer  software  for  phase  control  of  the 
elements  and  for  radar  signal  processing  is 
considered  to  be  included  in  the  radar,  and 
was  not  developed  as  part  of  the  attack 
management  software.  The  infrared  search 
and  track  (IRST)  set  is  assumed  to  have  a 
mechanically  scanned  gimbal;  it  can  measure 
the  angular  direction  and  intensity  of  a 
source  of  infrared  radiation.-  The  passive 
sensors  detect  and  measure  angular 
direction  and  identification  of 
radio-frequency  sources.  The  Identify 
Friend  or  Foe  (IFF)  set  can  interrogate  a 
target  and  determine  whether  it  gives  a 
response  identifying  it  as  friendly.  The 
wide-area  data  link,  as  simulated  in  this 
system,  provides  wide-area  communication  of 
battle  management  data  to  friendly  aircraft 
at  a  low  data  rate  (once  every  ten 
seconds).  Because  of  this  low  data  rate, 
there  were  limitations  on  how  completely 
wide-area  data  could  be  combined  (fused) 
with  on-board  sensor  data.  A  separate 
mtraflight  data  link  is  assumed  to 
communicate  data  between  aircraft  of  the 
same  flight  with  a  much  higher  data  rate 
than  the  wide-area  data  link,  but  with  a 
shorter  maximum  range  .- 

The  attack  management  software,  developed 
in  the  Ada  language,  was  implemented  in  the 
mission  data  processor  complex,  using  a 
distributed  processing  architecture  of  the 
type  developed  in  the  PAVE  PILLAR  program. 
Five  MIL-STD-1750A  (16-bit)  processors  were 
connected  to  each  other  and  to  a 
random-access  memory  by  a  high-speed  data 
bus.  The  requirement  for  five  processors 
was  determined  by  throughput  requirements; 
each  processor  had  a  throughput  capacity  of 
1.7  mega  instructions  per  second  (MIPS) . 

The  software  architecture  avoided  use  of 
the  parallel  tasking  feature  of  Ada,  which 
was  considered  to  be  a  possible  source  of 
trouble.  Instead,  parallel  operation  of 
independent,  separately-compiled  parts  of 
the  software  ("logical  processors")  was 
controlled  by  an  Ada-based  executive 
program  working  through  an  operating  system 
of  the  PAVE  PILLAR  type.  The  executive 
program  is  described  in  Reference  i.  The 
operation  of  the  mission  data  processor 
complex  depended  on  the  connection  of  the 
processors  to  a  common  data  base  in  the 
random  access  memory  hrough  a  parallel 
data  bus  with  a  capacity  of  ten  megawords 
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Figure  1.  Avionic  System  for  Air-to-Air  Attack  Management 


per  second.  The  random-acces~  memory  had  a 
capacity  of  256K  (where  K=1024)  16-bit 
words.  The  total  size  of  the  attack 
management  source  software  is  approximately 
20,000  lines  of  Ada.;  This  software  also 
has  been  adapted  to  a  single  32-bit 
computer  with  a  throughput  capacity  of  5 
MIPS  for  another  Wright  Laboratory  program 
(Reference  2),  which  is  to  include  flight 
test.  The  flow  of  dcta  in  the  system  is 
illustrated  in  Figure  2.  The  sensors 
provide  track  files,  consisting  of  target 
location  and  identification  data,  to  the 
attack  management  portion  of  the  system. 

The  attack  management  software  performs 
four  main  functions,  which  are  described 
below:  Sensor  Control,  Multisource 
Integration,  Internetting,  and  Fire-Control 
Decision  Aids. 

3.1  Bansor  Control  Function 

The  Sensor  Control  automatically  commands 
all  of  the  controllable  sensors  shown  in 
Figure  1,  subject  to  conditions  set  by  the 
pilot.  The  commands  it  gives  to  the 
sensors  include  sensor  modes,  areas  to  be 
searched,  targets  to  be  tracked,  and 
requests  to  provide  identification  data. 

The  pilot  selects  the  overall  search  area 
and  the  emission  mode;  active,  passive,  or 
low-probability-of-intercept..  The  Sensor 
Control  allocates  sensor  resources  to 
search  and  track  targets  based  on  an 
intelligent  prioritization  algorithm.  This 
prioritization  algorithm  allows  the  Sensor 
Control  to  react  to  the  changing  tactical 
situation.  The  Sensor  Control  is 
partitioned  into  five  functions.  The  first 
function,  switchboard  operations, 


determines  which  sensors  are  availab.e,  and 
for  each  available  sensor  it  determines 
which  active  tracks  it  can  service.  The 
second  function,  search  area  definition, 
computes  individual  sensor  search  areas. 

The  third  function,  track  file 
prioritization,  prioritizes  all  possible 
track  services  that  can  be  provided  for 
each  serviceable  MSI  track.  The  three 
types  of  track  services  available  are  track 
update,  track  identification,  and  track 
raid  assessment.  The  highest  priority  is 
given  to  targets  towards  which  missiles  are 
in  flight,  and  targets  which  are  next  in 
priority  for  a  missile  launch.  The  fourth 
function,  sensor  load  allocation, 
determines  the  sensor  services  to  be 
performed  by  each  controllable  sensor.  A 
selection  process  is  used  to  determine  the 
best  sensor  to  perform  a  given  service. 

The  last  function,  sensor  director,  is 
responsible  for  reformatting  the  sensor 
commands  m  a  form  acceptable  for  output 
for  each  controllable  sensor.  A  more 
complete  description  of  the  Sensor  Control 
algorithms  is  given  in  Reference  3. 

3.2  Multisource  Integration  (MSI)  Function 

The  MSI  function  combines  ("fuses")  target 
tracking  and  identification  data  from 
sensors  on  board  the  aircraft,  to  cope  with 
multiple  maneuvering  targets.  The  MSI 
algorithm,  as  implemented  in  this  system, 
takes  advantage  of  the  complementary 
characteristics  of  each  sensor,  making  full 
use  of  its  desirable  features,  while 
de-emphasizing  its  relative  weaknesses. 

The  analytical  vehicle  for  sensor  fusion  in 
this  system  is  the  Kalman  filter.  The 
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Figure  2.  Daia  Flow  in  Attack  Management 


range/range-rate  measurements  are  decoupled 
from  the  angle  measurements  in  the 
implementation.  Consequently,  if  a 
particular  sensor  report  has  angle  data 
only,  it  can  be  processed  in  the  usual  way, 
and  the  MSI  track  vector  can  be  updated 
with  angle-only  measurements  on  that 
particular  frame.  In  order  to  track 
maneuvering  targets,  the  Singer  algorithm 
is  incorporated  into  the  Kalman  filter, 
using  an  augmented  state  vector  that 
contains  acceleration  states.  The 
resulting  MSI  track  files  contain  fused 
target  location  and  identification  data 
from  all  sensors  on  board  the  aircraft. 

The  MSI  function  utilises  three 
subfunctions.  The  first  subfunction  is 
track  file  maintenance.-  This  is  a  central- 
level  kinematic  fusion  algorithm  that 
receives  inputs  from  various  sensors  and 
sequentially  fuses  them  into  a  track  file. 
Critical  algorithms  developed  for  this 
subfunction  include  sensor  track 
propagation,  MSI  track  propagation,  and  MSI 
correlation.  The  second  subtunction  is 
identification  assessment.  The 
identification  of  an  aircraft  is  determined 
by  fusing  all  the  identification  data 
available  on  an  MSI  track.  The  third 
subfunction  is  sensor  utility  assessment. 
This  estimates  the  ability  of  the  sensor  to 
update  an  existing  MSI  track  based  on  a 
record  of  its  past  performance  against 
active  MSI  tracks..  For  each  on-ooard 
tracking  sensor,  a  running  probability  is 
maintained  of  its  chances  of  success  in 
updating  the  MSI  track.  This  information 


is  used  by  the  sensor  manager  in 
determining  the  allocation  of  sensors  to 
tracks . 

3 . 3  Internetting  Function 
The  internetting  function  fuses  MSI  track 
files  and  attack  data  with  data  from  other 
friendly  aircraft  connected  (“internetted") 
by  an  intraflight  data  link,  and  supplies 
the  output  necessary  to  provide  each 
aircraft  with  the  same  picture  of  the 
battle  environment.  This  output  includes 
the  internetted  track  file  (ITF)  package 
from  which  each  aircraft  can  generate  a 
common  tactical  situation  display.  The 
intraflight  data  link  concept  is  based  on  a 
token-passing  protocol.-  The  aircraft  which 
possesses  the  token  updates  the  internetted 
track  files  with  data  from  its  own  MSI 
track  files,  then  broadcasts  the  updates  to 
all  other  members  of  the  cooperative  force. 
The  internetted  track  files  are  maintainod 
in  rectangular  Cartesian  coordinates 
referenced  to  a  common  grid.  The  three 
major  internetting  functions  are 
internetted  track  file  maintenance, 
cooperative  attack  planning,  and  data  link 
controller.  The  internetted  track  file 
maintenance  creates  internetted  track  files 
by  combining  ownship  MSI  files  with  the 
existing  track  files,  and  provides  passive 
ranging  capability  between  two  or  more 
aircraft  from  passive  sensor  angular  data. 
The  cooperative  attack  planning  performs 
attribute  integration,  computation  of 
threat  missile  launch  envelopes,  and 
cooperative  prioritization  of  the  targets. 
The  data  link  controller  provides  the 
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interface  for  information  transmitted  to 
and  received  from  intemetted  aircraft  over 
the  data  link. 

3.4  rire  Control  Decision  Aid  Function 
The  purpose  of  the  this  function  is  to 
compute  fire  control  information  for 
display  to  the  pilot  for  performing  a 
successful  attack.  The  information  to  be 
displayed  is  computed  from  the  intemetted 
data  and  the  MSI  data,  with  the  pilot 
providing  inputs  which  control  the  type  of 
information  computed  and  displayed. 
Suggestions  are  provided  to  the  pilot  on 
which  target  to  engage,  which  weapon  to 
use,  how  to  approach  the  target,  when  to 
fire  the  weapon,  and  the  outcome  of  the 
weapon/targat  engagement.  The  decision 
aids  displayed  to  the  pilot  were  described 
in  a  previous  paper  (Reference  4).  There 
are  six  major  decision  aid  subfunctions. 

The  first,  autonomous  prioritization, 
provides  a  suggested  order  of  engagement 
and  a  weapon  allocation.  The 
prioritization  and  allocation  are  presented 
to  the  pilot  and  an  override  capability  is 
provided.  Some  of  the  criteria  used  to 
determine  prioritization  are  relative 
geometry,  position  within  the  threat 
missile  launch  envelope,  first-shot 
probability,  and  target  type.  The  second 
subfunction,  attack  steering,  provides 
steering  cues  to  the  pilot  appropriate  to 
the  particular  weapon  to  be  deployed. 
Azimuth  and  elevation  cues  are  provided  for 
collision  steering  based  on  ownship  and 
missile  speeds  and  the  relative  position 
and  velocity  of  the  target.  The  third  and 
fourth  subfunctions  are  the  missile  launch 
envelopes  (MLE)  for  the  medium  and  short- 
range  missiles.  The  purpose  of  the  MLE  is 
to  indicate  to  the  pilot  the  effective 
launch  range  of  the  missile  and  when 
acceptable  launch  conditions  are  met.  The 


fifth  subfunction,  gun  steering,  provides 
visual  cues  to  the  pilot  for  firing  the 
gun.  It  provides  azimuth  and  elevation 
steering,  maximum  range,  and  a  break-off 
cue  when  disengaging  is  advisable.  The 
last  subfunction,  kill  assessment,  provides 
the  pilot  with  information  on  the  outcome 
of  a  missile  launched  against  a  target.  It 
computes  whether  the  missile  could  have 
reached  the  target,  and  uses  sensor  data  to 
determine  whether  a  kill  has  occurred  based 
on  kill  indications,  including  radar  and 
infrared  signatures  and  sensor-observed 
kinematics.  The  controls  and  displays  used 
by  the  pilot  in  the  cockpit  to  interface 
with  the  fire  control  decision  aids  will 
now  be  described. 

4.  COCKPIT  CONTROLS  AMD  DISPLAYS 

The  type  of  cockpit  for  which  the  control 
and  display  concepts  were  designed  is  shown 
in  Figure  3.  The  head-up  display  at  the 
top  displays  attack  information  superposed 
on  the  view  out  the  windshield.  Although 
flight  information  such  as  speed,  altitude, 
and  attitude  is  available  on  the  electronic 
displays,  backup  flight  instruments  are 
provided  for  flight  safety  reasons.  The 
special-purpose  alphanumeric  display  shows 
the  status  of  the  communication  and  data 
links.  The  instrument  panel  also  has  a 
master  arm  switch  and  switches  to  control 
the  mode  of  operation  of  the  sensor  control 
software;  with  them  the  pilot  chooses 
active,  passive,  or 

low-probability-of-intercept  operation  of 
sensors  such  as  the  radar.  The  three 
multi-function  colour  displays  have 
pushbutton  switches  in  the  bezels 
surrounding  them,  for  selecting  various 
display  formats  and  otherwise  interacting 
with  the  system.  The  pilot  can  activate 
these  buttons  either  by  pressing  them 


Figure  3.  Typical  Cockpit  for  Air-to-Air  Attack  Management 
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manually  or  by  using  the  target  designation 
switches  on  the  throttle. 


Figure  4  illustrates  the  switches  on  the 
throttle.  The  view  in  the  figure  is  of  the 
forward  and  right  sides  of  the  throttle, 
Where  the  switches  are  located.  The  Target 
Designator  control  (TDC)  is  used  to  control 
the  motion  of  a  cursor  used  to  select  a 
target  symbol  or  bezel  switch  on  a  display. 
When  the  cursor  has  been  placed  at  the 
position  of  the  target  or  the  switch, 
pressing  the  Designate  svitch  designates 
the  target  or  activates  the  switch.  A 
target  designated  by  the  pilot  becomes  the 


number  one  (highest)  priority  target, 
superseding  any  target  priority  determined 
by  the  fire-control  decision  aids.  The 
Cage/Uncage  switch  controls  caging  of  the 
target  seeker  of  the  short-range  infrared 
missile.  The  Chaff/Flare  switch  controls 
manual  release  of  chaff  and  flares. 


Figure  5  illustrates  the  switches  on  tne 
control  stick.  The  Sensor  Control  switch 
controls  the  sensor  search  displays  for 
ownship  or  for  selecting  the  Close  Look 
display  format,  as  well  as  controlling 
access  to  the  boresight  and  vertical 
acquisition  (VACQ)  Air  Combat  Maneuvering 


CHAFF/FLARE 


DESIGNATE 

CAGEAJNCAGE 


TARGET  DESIGNATOR 
CONTROL  (TDC) 

UP 

LEFT 


RIGHT 


DOWN 

SLEWS  CURSOR 


Figure  4.  Throttle  Switches 
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Figure  5.  Control  Stick  Switches 
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(ACM)  sensor  nodes.  The  Undesignate  switch 
is  used  to  renove  the  designation  of  a 
target  as  number  one  priority,  for  example, 
after  a  missile  has  been  launched  at  that 
target  and  the  pilot  does  not  want  to 
launch  a  second  missile  at  the  sane  target. 
It  is  also  used  to  leave  the  ACM  sensor 
modes.  The  Weapon  Release/Gun  Trigger 
launches  a  missile  or  fires  the  gun  at  the 
number  one  priority  target.  Whether  the 
gun  is  fired  or  a  missile  is  launched,  and 
the  type  of  missile  launched,  are 
determined  by  the  position  of  the 
Air-to-Air  Weapon  Select  switch  at  the  time 
the  Weapon  Release/Gun  Trigger  is 
depressed. 

Note  that  the  system  provides  for  all  major 
decisions  to  be  made  by  the  pilot.  The 
weapon  fired  is  always  determined  by  the 
position  of  the  Air-to-Air  Weapon  Select 
Switch,  as  selected  by  the  pilot.  The 
weapon  is  fired  or  launched  only  when  the 
pilot  presses  the  Weapon  Release/Gun 
Trigger.  The  target  at  which  the  weapon  is 
launched  is  always  the  target  designated 
manually  by  the  pilot,  if  he  has  selected 
one.  If  he  has  not  designated  a  target 
manually  before  he  presses  the  Weapon 
Release/Gun  Trigger,  the  selected  weapon  is 
fired  at  the  highest  priority  target,  as 
computed  by  the  system  and  displayed  to  the 
pilot.  The  p' lot  keeps  control  by  not 
firing  until  the  highest-priority  target  on 
the  display  is  the  one  he  wishes  to  shoot.. 

The  symbols  displayed  on  the  Head-up 
Display  (HUD)  were  developed  by  modifying 
those  used  in  present-day  aircraft.  Figure 
6  shows  the  display  used  when  the  medium- 
range  missile  has  been  selected.  The 
scales  on  the  left,  top,  and  right  show 
airspeed,  heading,  and  altitude, 


respectively.  The  vertical  scale  to  the 
left  of  the  altitude  scale  displays 
maximum,  minimum,  and  no-escape  missile 
launch  ranges  for  the  two  highest-priority 
targets,  with  the  highest  priority  target 
being  on  the  left  side  of  the  line.  The 
carets  (<)  with  the  numbers  inside  show  the 
present  target  ranges  and  closing  speeds. 
The  squares  are  target  designator  boxes 
showing  the  locations  of  the  two  highest- 
priority  targets.  The  asterisk  (*)  marks 
the  highest-priority  target,  which  is  the 
one  at  which  a  missile  will  be  launched 
when  the  pilot  presses  the  Weapon  Release 
switch.  In  the  center  of  the  display  are  a 
steering  dot  and  an  allowable  error  circle 
for  steering  toward  the  highest-priority 
target.  In  the  upper  right  are  the  numbers 
of  medium  and  short-range  missiles 
remaining  on  board.  If  the  system 
recommends  the  use  of  a  different  missile 
type  than  the  one  selected  by  the  pilot,  it 
indicates  this  by  an  arrow  pointing  to  the 
recommended  missile  type.-  In  the  lower 
right  are  the  time  until  the  missile  seeker 
is  active  and  the  time  until  intercept  for 
the  most  recently  fired  missiles.  The 
numbers  in  the  lower  left  corner  are  the 
Mach  number  and  acceleration  (in  g's)  of 
the  aircraft. 

Several  different  display  formats  can  be 
dif  played  on  the  head-down  Multi-Functio.i 
Colour  Display  (MFCD's) , 

Situation  format 
Tactical  Planning  format 
Close-Look  format  (with  optional 
variations) 

Threat  format 
System  Status  format 
Search  Volume  format 
Identification  Confidence  format 


Figure  6.  HUD  Medium  Range  Missile  Format 
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Since  the  three  MFCD's  in  the  cockpit  are 
of  equal  size,  it  is  possible  to  put  any 
display  format  in  any  of  the  three  display 
locations..  The  situation  format  is 
important  enough  to  be  displayed  at  all 
times  on  one  location.  The  pilot  is  given 
the  choice  of  the  Tactical  Planning  or 
Close-Look  format  in  a  second  location.  He 
can  choose  any  of  the  remaining  four 
formats  for  the  third  location,  in  the 
flight  simulations,  the  Situation  Format 
was  located  on  the  right  display,  w.th  the 
Tactical  Planning  and  Close-Look  formats  in 
the  center,  as  described  in  Reference  4. 

The  Situation  Format  shows  fused  location 
and  identification  information  on  all 
aircraft  for  which  data  are  available,  as 
well  as  navigation  and  other  data.  Figure 
7  shows  an  example  of  a  Situation  format 
display.  The  scale  of  the  display  can  be 
changed  by  switches  on  the  bezel,  other 
switches  allow  the  pilot  to  select  the 
amount  of  detail  displayed;  eliminating 
some  displayed  data  makes  the  display  less 
cluttered.  Some  of  the  optional  items  are: 

targev  identification 
target  altitude  and  speed 
planned  route,  corridor,  and  waypoints 
hostile  surface-to-air  missile  sites 


Target  symbols  used  on  the  displays  are 
defined  in  Figure  8.  The  symbols  are 
either  outlines  or  filled  in  (solid) , 
depending  on  the  source  of  the  target  data. 
When  the  pilot  has  pressed  the  button 
marked  "SELF",  only  the  targets  tracked  by 
ownship  sensors  are  filled  in.  Otherwise, 
all  targets  tracked  by  aircraft  on  the 
intraflight  data  link  are  filled  in,  and 
only  wide-area  data  link  targets  are  shown 
as  outlines.  These  features  help  the  pilot 
to  decide  whether  the  target  track  is 
accurate  enough  for  launching  a  missile. 

The  basic  Tactical  Planning  Format  is 
similar  to  the  Situation  format,  but  has 
some  different  display  options  avail *ble, 
such  as  missile  launch  ranges.  On  it  the 
pilot  can  request  a  Close-Look  display  of 
the  area  around  the  target  designated  by 
the  close-look  symbol.  The  Close-Look 
format  can  display  recommended  target 
priorities  and  other  data  requested  by  the 
pilot.  .  Examples  of  Tactical  Planning, 
Close-Look,  and  Situation  format  displays 
were  shown  and  discussed  in  Reference  4  for 
a  representative  engagement. 

The  Threat  format  is  displayed  in  the 
remaining  display  location  when  no  other 
format  has  been  selected.  An  example  of  a 
Threat  format  is  shown  in  Figure  9.  This 


Figure  7.  Situation  Format 
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Figure  8.  Target  Symbols 


is  a  plan  view  on  which  the  location  of 
hostile  aircraft  and  hostile  surface-to-air 
missile  (SAM)  sites  are  displayed,  together 
with  indications  of  jamming  and  hostile  SAM 
and  air-to-air  missile  launches. 

Pushbuttons  on  the  bezel  are  used  to 
display  the  Search  Volume  and  System  Status 


formats  and  to  control  the  sensor  search 
area.  On  the  Search  Volume  and  System 
Status  displays,  the  pilot  can  select  a 
display  of  information  for  his  own 
aircraft,  or  for  other  aircraft  internetted 
by  the  intraflight  data  link.  An  example 
of  a  System  Status  format  is  shown  in 
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Figure  10.  It  is  a  pictorial  display  of 
the  status  of  fuel,  thrust,  weapons,- 
jammers,  chaff,  and  flares.  An  example  of 
a  Search  Volume  format  is  shown  in  Figure 
11.  The  lower  part  of  the  display  is  a 
plan  view,  and  the  upper  part  is  an 
elevation  view,  altitude  vs.  range.  The 
pilot  can  display  the  search  volumes  for 
other  aircraft  in  his  flight,  but  he  cannot 
change  them  with  his  controls.  The 


capability  could  have  been  put  into  the 
system,  but  the  pilots  felt  strongly  that 
it  would  create  undesirable  confusion.  The 
Identification  Confidence  format  is  not 
shown  here,  since  it  is  expected  to  be  used 
only  in  special  cases.  The  pilot  can 
request  it  if  he  wants  to  see  details  of 
sources  of  the  target  identification  data 
used  in  a  Close-Look  format  option. 
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Figure  10.  System  Status  Format 
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5.  INTEGRATION  HDD  TEST 

The  software  for  the  mission  data 
processors  was  developed  in  the  Ada 
language.  Parts  of  the  code  were  developed 
by  subcontractors?  the  Boeing  Military 
Airplane  Company  developed  the 
pilot/vehicle  interface  (control  and 
display)  software,  and  the  TAU  Corporation 
developed  the  Sensor  Control  software.  The 
subcontractors  used  the  same  model  of  VAX 
computer  and  compiler  as  the  prime 
contractor,  the  Northrop  Corporation.  The 
top-down  design  provided  for  the  modular 
distributed  data  processing  to  be 
controlled  through  a  common  data  base. 

Early  definition  and  control  of  the  common 
data  base  were  necessary  to  coordinate  the 
software  design.  Integration  of  the 
software  was  performed  in  Northrop 's 
Avionic  Integration  Laboratory  (AIL) .  The 
first  steps  in  integration  used  the  VAX 
computer  and  the  VAX  Ada  compiler.;  An 
emulator  was  used  to  represent  the  effects 
of  the  distributed  processing  operating 
system.  Then  the  software  was  recompiled 
and  hosted  on  the  MIL-STD-1750A  computers 
in  the  mission  data  processor  complex. 
Integration  was  continued  in  the  AIL  with 
the  mission  data  processor  complex 
connected  to  an  Encore  computer  of  the  same 
type  used  in  the  flight  simulator.  As  in 
the  flight  simulator  laboratory,  the  Encore 
computer  included  mathematical  models  of 
the  sensors  and  other  simulation  variables, 
for  more  complete  real-time  integration 
testing  than  was  possible  on  the  VAX 
computer. 

Ihe  final  integration  and  test  were 
performed  in  Northrop' s  flight  simulator 
laboratory.  This  laboratory  uses  a  complex 
of  Encore  Concept  32/9780  computers  and 
Floating  Point  System  array  processors  to 
implement  mathematical  models  of  the 
sensors,  aircraft,  weapons,  targets,  and 
geometry.  The  same  mission  data  processor 
computer  complex  hardware  and  software  used 
in  the  AIL  were  used  in  the  flight 
simulator  laboratory.  Two  manned 
Interactive  control  Stations  (MICS)  were 
used  for  the  cockpit  controls  and  displays, 
each  with  its  own  mission  data  processor 
complex,  control  stick,  throttle,  and  with 
the  displays  represented  on  a  Silicon 
Graphics,  Inc.  display  processor.  The 
pilotr  considered  the  limited  visual 
realism  of  the  display  to  be  satisfactory 
for  the  conditions  used,  in  which  the  most 
significant  action  was  beyond  visual  range. 
After  the  first  flight  simulator  evaluation 
period,  these  friendly  ("blue")  control 
stations  (MICS)  could  be  replaced  by  two 
MICS  which  represented  an  avionics  system 
without  the  attack  management  system,  for 
comparison  of  results  to  evaluate  the 
effects  of  the  attack  management  system. 

The  enemy  ("red”)  aircraft  in  the 
simulation  were  a  mixture  of  MICS  (manned) 
and  computer-simulated  ("digital”)  targets. 
The  digital  targets  were  simulated  by 
computer  programs  using  logic  representing 
fighter  aircraft  tactics. 

The  first  demonstration  and  evaluation  on 
the  flight  simulator  was  in  May  1990.  The 
evaluation  period  was  two  weeks,  following 
four  days  of  pilot  training  in  operation  of 
the  system.  Three  teams  of  two  pilots  each 


took  turns  manning  the  two  blue  stations, 
with  the  red  aircraft  being  six  computer- 
simulated  targets.  The  pilots  were  U.  S, 
Air  Force  ca  -tains  with  air-to-air 
experience  in  the  Tactical  Air  Command. 

The  system  was  evaluated  as  having  a  very 
great  potential,  but  needing  some 
corrections  and  improvements  in  the 
software,  controls,  and  displays.  Another 
evaluation  on  the  flight  simulator  was 
performed  in  August  1991,  after  the 
algorithms  and  control  and  display  concepts 
were  modified  for  greater  pilot  acceptance. 

Evaluation  of  the  system  was  broken  down 
into  six  categories.  The  first  category, 
top-level  measures  of  performance  (MOP)  and 
measures  of  effectiveness  (MOE) ,  focused  on 
the  performance  of  the  system  during  the 
simulation.  Specific  MOP's  and  MOE's  are 
listed  in  Figure  12.  The  second  category 
concerned  the  performance  of  individual 
algorithms  or  combination  of  algorithms 
within  ths  system.  Specific  tests  that 
were  performed  are  listed  in  Figure  13. 

Ths  third  category,  tracking  loop  analysis, 
focused  on  single-ship  tracking 
performance.  Specific  tests  include 
measuring  the  contributions  of  the  various 
sensors  to  tracking  and  identification, 
effects  on  tracking  performance  of  being  in 
the  low-probability-of-intercept  or  passive 
modes,  and  measuring  the  MSI  and 
internetted  track  filter  covariances  over 
time.  The  fourth  category,  internetting, 
was  concerned  with  the  performance  of  the 
internetting  data  link.  The  measures 
employed  were  the  percent  of  time  spent  in 
the  data  link  and  the  token  rate  as  a 
function  of  the  number  of  tracks. 
Join/rejoin  characteristics  were  also 
characterized  by  measuring  such  parameters 
as  the  number  of  tracks  passed  over  the 
link  during  rejoin,  the  amount  of  time  it 
took  for  correlation,  and  the  total  amount 
of  time  before  normal  data  processing  could 
proceed.  The  fifth  category,  weapon 
employment  and  intercept,  focused  on  the 
pilot's  use  of  decision  aids  and  the 
performance  of  the  missile  in  the 
simulation.  Some  examples  of  tests  in  this 
area  were  pilot  usage  of  the  priority 
target  and  allocated  weapon,  accuracy  of 
post-launch  cues,  missila  launch  results 
and  missile  intercept  characteristics.  The 
final  category,  pilot/vehicle  interface, 
focused  on  the  pilot's  use  of  switches  and 
displays. 

«.  CONCLUSIONS 

The  major  conclusion  of  the  test  and 
evaluation  was  that  the  system  provides 
improved  situation  awareness  and  decreased 
work  load  for  the  pilot,  improving  his 
combat  effectiveness.  Other  conclusions 
resulting  from  the  software  development, 
integration,  and  flight  simulation  effort 
are  as  follows. 

The  Ada  language  was  well  adapted  for  this 
system.  The  use  of  Ada  was  successful 
after  the  compiler  used  became  mature. 
Merely  passing  the  Ada  compiler  validation 
tests  does  not  guarantee  an  error-free 
compiler. 

The  distributed  processing  architecture, 
with  modules  coupled  through  a  common  data 
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base  am'  a  high-speed  data  bus,  was 
successful .  With  this  architecture,  it  was 
important  to  have  early  definition  and 
control  of  the  data  base  and  early 
attention  to  bus  loading  and  protocols. 

With  asynchronous  operation  of  software 
modules,  constant  attention  to  the  timing 
of  data  transfer  was  necessary. 

The  pilots  considered  the  flight  simulation 
*•0  be  adequate  for  valid  evaluation  of  the 
system,  in  spite  of  the  limited  realism  of 
the  visual  scene.  This  was  because  the 
scenarios,  medium-range  missiles,  and 
be.ond-visual  range  (BVR)  target 
identification  used  resulted  in  BVR 
engagements . 

The  data  rate  used  in  the  simulation  for 
the  wide-area  data  link,  once  every  10 
seconds,  did  not  give  precise  enough  data 
to  be  fused  mathematically  with  high-rate 
data.  However,  the  wide-area  data  link 
targets  could  be  displayed  to  the  pilot  on 
the  same  display  as  the  other  targets. 

Specific  results  in  regard  to  the  six 
cateaories  of  testing  that  were  discussed 
above  were  not  available  Ln  time  for  this 
paper. 
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